diff --git a/docs/_posts/ahmedlone127/2024-08-20-20231130_5_en.md b/docs/_posts/ahmedlone127/2024-08-20-20231130_5_en.md new file mode 100644 index 00000000000000..deff8c207bc54a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20231130_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20231130_5 T5Transformer from picas9dan +author: John Snow Labs +name: 20231130_5 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_5` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_5_en_5.4.2_3.0_1724151659414.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_5_en_5.4.2_3.0_1724151659414.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20231130_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20231130_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20231130_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/picas9dan/20231130_5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20231130_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-20231130_5_pipeline_en.md new file mode 100644 index 00000000000000..d2b49ef20865f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20231130_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20231130_5_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20231130_5_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_5_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_5_pipeline_en_5.4.2_3.0_1724151706044.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_5_pipeline_en_5.4.2_3.0_1724151706044.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20231130_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20231130_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20231130_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/picas9dan/20231130_5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20240116_4_en.md b/docs/_posts/ahmedlone127/2024-08-20-20240116_4_en.md new file mode 100644 index 00000000000000..00634c17646540 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20240116_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240116_4 T5Transformer from picas9dan +author: John Snow Labs +name: 20240116_4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240116_4` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240116_4_en_5.4.2_3.0_1724189332395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240116_4_en_5.4.2_3.0_1724189332395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240116_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240116_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240116_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/picas9dan/20240116_4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20240116_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-20240116_4_pipeline_en.md new file mode 100644 index 00000000000000..8b95d2c7639fc9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20240116_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240116_4_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240116_4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240116_4_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240116_4_pipeline_en_5.4.2_3.0_1724189379593.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240116_4_pipeline_en_5.4.2_3.0_1724189379593.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240116_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240116_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240116_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/picas9dan/20240116_4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20240127_7_en.md b/docs/_posts/ahmedlone127/2024-08-20-20240127_7_en.md new file mode 100644 index 00000000000000..2f08b18ce16804 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20240127_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240127_7 T5Transformer from picas9dan +author: John Snow Labs +name: 20240127_7 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240127_7` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240127_7_en_5.4.2_3.0_1724178584787.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240127_7_en_5.4.2_3.0_1724178584787.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240127_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240127_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240127_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240127_7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20240127_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-20240127_7_pipeline_en.md new file mode 100644 index 00000000000000..70b7ce5d2088c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20240127_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240127_7_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240127_7_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240127_7_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240127_7_pipeline_en_5.4.2_3.0_1724178727329.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240127_7_pipeline_en_5.4.2_3.0_1724178727329.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240127_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240127_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240127_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240127_7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20240510_7_en.md b/docs/_posts/ahmedlone127/2024-08-20-20240510_7_en.md new file mode 100644 index 00000000000000..eb09d671796ff9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20240510_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240510_7 T5Transformer from picas9dan +author: John Snow Labs +name: 20240510_7 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240510_7` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240510_7_en_5.4.2_3.0_1724184460621.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240510_7_en_5.4.2_3.0_1724184460621.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240510_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240510_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240510_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240510_7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20240510_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-20240510_7_pipeline_en.md new file mode 100644 index 00000000000000..f1e966d8344a38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20240510_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240510_7_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240510_7_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240510_7_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240510_7_pipeline_en_5.4.2_3.0_1724184594972.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240510_7_pipeline_en_5.4.2_3.0_1724184594972.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240510_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240510_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240510_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240510_7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20240516_4_en.md b/docs/_posts/ahmedlone127/2024-08-20-20240516_4_en.md new file mode 100644 index 00000000000000..e7fa89e43677f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20240516_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240516_4 T5Transformer from picas9dan +author: John Snow Labs +name: 20240516_4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240516_4` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240516_4_en_5.4.2_3.0_1724154820116.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240516_4_en_5.4.2_3.0_1724154820116.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240516_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240516_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240516_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/picas9dan/20240516_4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-20240516_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-20240516_4_pipeline_en.md new file mode 100644 index 00000000000000..8bfd27af49c8d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-20240516_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240516_4_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240516_4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240516_4_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240516_4_pipeline_en_5.4.2_3.0_1724154869102.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240516_4_pipeline_en_5.4.2_3.0_1724154869102.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240516_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240516_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240516_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/picas9dan/20240516_4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-aaa_sql_v2_en.md b/docs/_posts/ahmedlone127/2024-08-20-aaa_sql_v2_en.md new file mode 100644 index 00000000000000..83a53a26ada42d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-aaa_sql_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English aaa_sql_v2 T5Transformer from abdullahsn +author: John Snow Labs +name: aaa_sql_v2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`aaa_sql_v2` is a English model originally trained by abdullahsn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/aaa_sql_v2_en_5.4.2_3.0_1724178544334.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/aaa_sql_v2_en_5.4.2_3.0_1724178544334.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("aaa_sql_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("aaa_sql_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|aaa_sql_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/abdullahsn/AAA-SQL-V2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-aaa_sql_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-aaa_sql_v2_pipeline_en.md new file mode 100644 index 00000000000000..52755768552851 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-aaa_sql_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English aaa_sql_v2_pipeline pipeline T5Transformer from abdullahsn +author: John Snow Labs +name: aaa_sql_v2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`aaa_sql_v2_pipeline` is a English model originally trained by abdullahsn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/aaa_sql_v2_pipeline_en_5.4.2_3.0_1724178633785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/aaa_sql_v2_pipeline_en_5.4.2_3.0_1724178633785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("aaa_sql_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("aaa_sql_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|aaa_sql_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/abdullahsn/AAA-SQL-V2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_10_spider_10_wikisql_en.md b/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_10_spider_10_wikisql_en.md new file mode 100644 index 00000000000000..8d1dd117607012 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_10_spider_10_wikisql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5_base_10_spider_10_wikisql T5Transformer from NatthawatTung +author: John Snow Labs +name: all_mt5_base_10_spider_10_wikisql +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_10_spider_10_wikisql` is a English model originally trained by NatthawatTung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_10_spider_10_wikisql_en_5.4.2_3.0_1724194674454.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_10_spider_10_wikisql_en_5.4.2_3.0_1724194674454.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5_base_10_spider_10_wikisql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5_base_10_spider_10_wikisql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_10_spider_10_wikisql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/NatthawatTung/ALL_mt5-base_10_spider_10_wikiSQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_15_spider_10_wikisql_sch_en.md b/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_15_spider_10_wikisql_sch_en.md new file mode 100644 index 00000000000000..96d99c509202ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_15_spider_10_wikisql_sch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5_base_15_spider_10_wikisql_sch T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_15_spider_10_wikisql_sch +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_15_spider_10_wikisql_sch` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_10_wikisql_sch_en_5.4.2_3.0_1724183137962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_10_wikisql_sch_en_5.4.2_3.0_1724183137962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5_base_15_spider_10_wikisql_sch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5_base_15_spider_10_wikisql_sch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_15_spider_10_wikisql_sch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_15_spider_10_wikiSQL_sch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_15_spider_10_wikisql_sch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_15_spider_10_wikisql_sch_pipeline_en.md new file mode 100644 index 00000000000000..ed26e7b50627f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-all_mt5_base_15_spider_10_wikisql_sch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_mt5_base_15_spider_10_wikisql_sch_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_15_spider_10_wikisql_sch_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_15_spider_10_wikisql_sch_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_10_wikisql_sch_pipeline_en_5.4.2_3.0_1724183402635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_10_wikisql_sch_pipeline_en_5.4.2_3.0_1724183402635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_mt5_base_15_spider_10_wikisql_sch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_mt5_base_15_spider_10_wikisql_sch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_15_spider_10_wikisql_sch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_15_spider_10_wikiSQL_sch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-autotrain_headset_sku2_en.md b/docs/_posts/ahmedlone127/2024-08-20-autotrain_headset_sku2_en.md new file mode 100644 index 00000000000000..35c91b79eebff6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-autotrain_headset_sku2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_headset_sku2 T5Transformer from duhmiko +author: John Snow Labs +name: autotrain_headset_sku2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_headset_sku2` is a English model originally trained by duhmiko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_headset_sku2_en_5.4.2_3.0_1724197959938.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_headset_sku2_en_5.4.2_3.0_1724197959938.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_headset_sku2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_headset_sku2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_headset_sku2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|331.6 MB| + +## References + +https://huggingface.co/duhmiko/autotrain-headset-sku2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-autotrain_headset_sku2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-autotrain_headset_sku2_pipeline_en.md new file mode 100644 index 00000000000000..6a0a1b06b015ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-autotrain_headset_sku2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_headset_sku2_pipeline pipeline T5Transformer from duhmiko +author: John Snow Labs +name: autotrain_headset_sku2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_headset_sku2_pipeline` is a English model originally trained by duhmiko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_headset_sku2_pipeline_en_5.4.2_3.0_1724197981600.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_headset_sku2_pipeline_en_5.4.2_3.0_1724197981600.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_headset_sku2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_headset_sku2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_headset_sku2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|331.6 MB| + +## References + +https://huggingface.co/duhmiko/autotrain-headset-sku2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-autotrain_hu2ir_jotv8_en.md b/docs/_posts/ahmedlone127/2024-08-20-autotrain_hu2ir_jotv8_en.md new file mode 100644 index 00000000000000..b32e0eceff3008 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-autotrain_hu2ir_jotv8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_hu2ir_jotv8 T5Transformer from tombenj +author: John Snow Labs +name: autotrain_hu2ir_jotv8 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_hu2ir_jotv8` is a English model originally trained by tombenj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_hu2ir_jotv8_en_5.4.2_3.0_1724178907671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_hu2ir_jotv8_en_5.4.2_3.0_1724178907671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_hu2ir_jotv8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_hu2ir_jotv8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_hu2ir_jotv8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/tombenj/autotrain-hu2ir-jotv8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-autotrain_hu2ir_jotv8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-autotrain_hu2ir_jotv8_pipeline_en.md new file mode 100644 index 00000000000000..b1eb0f34ae39eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-autotrain_hu2ir_jotv8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_hu2ir_jotv8_pipeline pipeline T5Transformer from tombenj +author: John Snow Labs +name: autotrain_hu2ir_jotv8_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_hu2ir_jotv8_pipeline` is a English model originally trained by tombenj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_hu2ir_jotv8_pipeline_en_5.4.2_3.0_1724178910282.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_hu2ir_jotv8_pipeline_en_5.4.2_3.0_1724178910282.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_hu2ir_jotv8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_hu2ir_jotv8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_hu2ir_jotv8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/tombenj/autotrain-hu2ir-jotv8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-autotrain_testproj_722121991_en.md b/docs/_posts/ahmedlone127/2024-08-20-autotrain_testproj_722121991_en.md new file mode 100644 index 00000000000000..0b0d72b650ebd4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-autotrain_testproj_722121991_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_testproj_722121991 T5Transformer from Hodiden +author: John Snow Labs +name: autotrain_testproj_722121991 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_testproj_722121991` is a English model originally trained by Hodiden. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_testproj_722121991_en_5.4.2_3.0_1724167510931.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_testproj_722121991_en_5.4.2_3.0_1724167510931.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_testproj_722121991","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_testproj_722121991", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_testproj_722121991| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Hodiden/autotrain-TestProj-722121991 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-autotrain_testproj_722121991_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-autotrain_testproj_722121991_pipeline_en.md new file mode 100644 index 00000000000000..6ec85a0b317600 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-autotrain_testproj_722121991_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_testproj_722121991_pipeline pipeline T5Transformer from Hodiden +author: John Snow Labs +name: autotrain_testproj_722121991_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_testproj_722121991_pipeline` is a English model originally trained by Hodiden. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_testproj_722121991_pipeline_en_5.4.2_3.0_1724167662981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_testproj_722121991_pipeline_en_5.4.2_3.0_1724167662981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_testproj_722121991_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_testproj_722121991_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_testproj_722121991_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Hodiden/autotrain-TestProj-722121991 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_en.md b/docs/_posts/ahmedlone127/2024-08-20-banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_en.md new file mode 100644 index 00000000000000..8dfcfc8f865dcd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali T5Transformer from Shadman-Rohan +author: John Snow Labs +name: banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali` is a English model originally trained by Shadman-Rohan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_en_5.4.2_3.0_1724186257874.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_en_5.4.2_3.0_1724186257874.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shadman-Rohan/banglat5_banglaparaphrase-finetuned-bn-to-bn \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline_en.md new file mode 100644 index 00000000000000..93b01a5787294d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline pipeline T5Transformer from Shadman-Rohan +author: John Snow Labs +name: banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline` is a English model originally trained by Shadman-Rohan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline_en_5.4.2_3.0_1724186305301.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline_en_5.4.2_3.0_1724186305301.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_banglaparaphrase_finetuned_bengali_tonga_tonga_islands_bengali_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shadman-Rohan/banglat5_banglaparaphrase-finetuned-bn-to-bn + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-bdp_summarization_t9_en.md b/docs/_posts/ahmedlone127/2024-08-20-bdp_summarization_t9_en.md new file mode 100644 index 00000000000000..6c6c8222229376 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-bdp_summarization_t9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bdp_summarization_t9 T5Transformer from DamianoDiPaola +author: John Snow Labs +name: bdp_summarization_t9 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bdp_summarization_t9` is a English model originally trained by DamianoDiPaola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bdp_summarization_t9_en_5.4.2_3.0_1724164591061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bdp_summarization_t9_en_5.4.2_3.0_1724164591061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bdp_summarization_t9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bdp_summarization_t9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bdp_summarization_t9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.6 MB| + +## References + +https://huggingface.co/DamianoDiPaola/bdp_summarization_T9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-bdp_summarization_t9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-bdp_summarization_t9_pipeline_en.md new file mode 100644 index 00000000000000..9661c1850f229f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-bdp_summarization_t9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bdp_summarization_t9_pipeline pipeline T5Transformer from DamianoDiPaola +author: John Snow Labs +name: bdp_summarization_t9_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bdp_summarization_t9_pipeline` is a English model originally trained by DamianoDiPaola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bdp_summarization_t9_pipeline_en_5.4.2_3.0_1724164608146.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bdp_summarization_t9_pipeline_en_5.4.2_3.0_1724164608146.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bdp_summarization_t9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bdp_summarization_t9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bdp_summarization_t9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.6 MB| + +## References + +https://huggingface.co/DamianoDiPaola/bdp_summarization_T9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-bhasa_model_en.md b/docs/_posts/ahmedlone127/2024-08-20-bhasa_model_en.md new file mode 100644 index 00000000000000..07c5fdd8fa2373 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-bhasa_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bhasa_model T5Transformer from djinnn +author: John Snow Labs +name: bhasa_model +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bhasa_model` is a English model originally trained by djinnn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bhasa_model_en_5.4.2_3.0_1724151766252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bhasa_model_en_5.4.2_3.0_1724151766252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bhasa_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bhasa_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bhasa_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/djinnn/Bhasa_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-boolq_t5_large_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-20-boolq_t5_large_seed_3_en.md new file mode 100644 index 00000000000000..768e7886859eeb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-boolq_t5_large_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English boolq_t5_large_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_large_seed_3 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_large_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_3_en_5.4.2_3.0_1724197565115.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_3_en_5.4.2_3.0_1724197565115.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("boolq_t5_large_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("boolq_t5_large_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_large_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-large_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-boolq_t5_large_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-boolq_t5_large_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..f3d2517ab095db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-boolq_t5_large_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English boolq_t5_large_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_large_seed_3_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_large_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724197751564.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724197751564.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("boolq_t5_large_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("boolq_t5_large_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_large_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-large_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_mrbelleza_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_mrbelleza_en.md new file mode 100644 index 00000000000000..28089b50968d80 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_mrbelleza_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_mrbelleza T5Transformer from mrbelleza +author: John Snow Labs +name: burmese_awesome_opus_books_model_mrbelleza +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_mrbelleza` is a English model originally trained by mrbelleza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mrbelleza_en_5.4.2_3.0_1724194695102.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mrbelleza_en_5.4.2_3.0_1724194695102.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_mrbelleza","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_mrbelleza", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_mrbelleza| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|331.5 MB| + +## References + +https://huggingface.co/mrbelleza/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_mrbelleza_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_mrbelleza_pipeline_en.md new file mode 100644 index 00000000000000..d268ef044768a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_mrbelleza_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_mrbelleza_pipeline pipeline T5Transformer from mrbelleza +author: John Snow Labs +name: burmese_awesome_opus_books_model_mrbelleza_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_mrbelleza_pipeline` is a English model originally trained by mrbelleza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mrbelleza_pipeline_en_5.4.2_3.0_1724194719508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mrbelleza_pipeline_en_5.4.2_3.0_1724194719508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_mrbelleza_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_mrbelleza_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_mrbelleza_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|331.5 MB| + +## References + +https://huggingface.co/mrbelleza/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_rsaketh02_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_rsaketh02_en.md new file mode 100644 index 00000000000000..99db1c22d19c11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_rsaketh02_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_rsaketh02 T5Transformer from rsaketh02 +author: John Snow Labs +name: burmese_awesome_opus_books_model_rsaketh02 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_rsaketh02` is a English model originally trained by rsaketh02. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rsaketh02_en_5.4.2_3.0_1724179865540.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rsaketh02_en_5.4.2_3.0_1724179865540.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_rsaketh02","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_rsaketh02", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_rsaketh02| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.4 MB| + +## References + +https://huggingface.co/rsaketh02/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_rsaketh02_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_rsaketh02_pipeline_en.md new file mode 100644 index 00000000000000..683f82dbc9fcc1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_rsaketh02_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_rsaketh02_pipeline pipeline T5Transformer from rsaketh02 +author: John Snow Labs +name: burmese_awesome_opus_books_model_rsaketh02_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_rsaketh02_pipeline` is a English model originally trained by rsaketh02. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rsaketh02_pipeline_en_5.4.2_3.0_1724179884767.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_rsaketh02_pipeline_en_5.4.2_3.0_1724179884767.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_rsaketh02_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_rsaketh02_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_rsaketh02_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.4 MB| + +## References + +https://huggingface.co/rsaketh02/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_xiurx_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_xiurx_en.md new file mode 100644 index 00000000000000..10991e89db7854 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_xiurx_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_xiurx T5Transformer from XIURX +author: John Snow Labs +name: burmese_awesome_opus_books_model_xiurx +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_xiurx` is a English model originally trained by XIURX. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_xiurx_en_5.4.2_3.0_1724189796533.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_xiurx_en_5.4.2_3.0_1724189796533.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_xiurx","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_xiurx", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_xiurx| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/XIURX/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_xiurx_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_xiurx_pipeline_en.md new file mode 100644 index 00000000000000..92a1802e2190da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_xiurx_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_xiurx_pipeline pipeline T5Transformer from XIURX +author: John Snow Labs +name: burmese_awesome_opus_books_model_xiurx_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_xiurx_pipeline` is a English model originally trained by XIURX. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_xiurx_pipeline_en_5.4.2_3.0_1724189815633.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_xiurx_pipeline_en_5.4.2_3.0_1724189815633.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_xiurx_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_xiurx_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_xiurx_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/XIURX/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_yuntaeyang_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_yuntaeyang_en.md new file mode 100644 index 00000000000000..a339682dee5348 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_yuntaeyang_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_yuntaeyang T5Transformer from yuntaeyang +author: John Snow Labs +name: burmese_awesome_opus_books_model_yuntaeyang +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_yuntaeyang` is a English model originally trained by yuntaeyang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_yuntaeyang_en_5.4.2_3.0_1724160610433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_yuntaeyang_en_5.4.2_3.0_1724160610433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_yuntaeyang","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_yuntaeyang", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_yuntaeyang| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.8 MB| + +## References + +https://huggingface.co/yuntaeyang/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_yuntaeyang_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_yuntaeyang_pipeline_en.md new file mode 100644 index 00000000000000..facf38f00f415b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_awesome_opus_books_model_yuntaeyang_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_yuntaeyang_pipeline pipeline T5Transformer from yuntaeyang +author: John Snow Labs +name: burmese_awesome_opus_books_model_yuntaeyang_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_yuntaeyang_pipeline` is a English model originally trained by yuntaeyang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_yuntaeyang_pipeline_en_5.4.2_3.0_1724160632151.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_yuntaeyang_pipeline_en_5.4.2_3.0_1724160632151.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_yuntaeyang_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_yuntaeyang_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_yuntaeyang_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.8 MB| + +## References + +https://huggingface.co/yuntaeyang/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_model2_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_model2_en.md new file mode 100644 index 00000000000000..856ac4c31589d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_model2_en.md @@ -0,0 +1,98 @@ +--- +layout: model +title: English burmese_model2 DistilBertForSequenceClassification from dradamskelton +author: John Snow Labs +name: burmese_model2 +date: 2024-08-20 +tags: [bert, en, open_source, sequence_classification, onnx] +task: Text Classification +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained DistilBertForSequenceClassification model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_model2` is a English model originally trained by dradamskelton. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_model2_en_5.4.2_3.0_1724153293310.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_model2_en_5.4.2_3.0_1724153293310.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +document_assembler = DocumentAssembler()\ + .setInputCol("text")\ + .setOutputCol("document") + +tokenizer = Tokenizer()\ + .setInputCols("document")\ + .setOutputCol("token") + +sequenceClassifier = DistilBertForSequenceClassification.pretrained("burmese_model2","en")\ + .setInputCols(["document","token"])\ + .setOutputCol("class") + +pipeline = Pipeline().setStages([document_assembler, tokenizer, sequenceClassifier]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val document_assembler = new DocumentAssembler() + .setInputCol("text") + .setOutputCol("document") + +val tokenizer = new Tokenizer() + .setInputCols("document") + .setOutputCol("token") + +val sequenceClassifier = DistilBertForSequenceClassification.pretrained("burmese_model2","en") + .setInputCols(Array("document","token")) + .setOutputCol("class") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, tokenizer, sequenceClassifier)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_model2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|319.9 MB| + +## References + +References + +https://huggingface.co/dradamskelton/my_model2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_model2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_model2_pipeline_en.md new file mode 100644 index 00000000000000..95e593660e6f5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_model2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_model2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: burmese_model2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_model2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_model2_pipeline_en_5.4.2_3.0_1724153311530.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_model2_pipeline_en_5.4.2_3.0_1724153311530.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_model2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_model2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_model2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|319.9 MB| + +## References + +https://huggingface.co/sheoran95/my_model2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_random_t5_ft_2_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_random_t5_ft_2_en.md new file mode 100644 index 00000000000000..7b1536e5c4587b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_random_t5_ft_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_random_t5_ft_2 T5Transformer from abdiharyadi +author: John Snow Labs +name: burmese_random_t5_ft_2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_random_t5_ft_2` is a English model originally trained by abdiharyadi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_random_t5_ft_2_en_5.4.2_3.0_1724160572414.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_random_t5_ft_2_en_5.4.2_3.0_1724160572414.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_random_t5_ft_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_random_t5_ft_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_random_t5_ft_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|997.6 MB| + +## References + +https://huggingface.co/abdiharyadi/my-random-t5-ft-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_random_t5_ft_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_random_t5_ft_2_pipeline_en.md new file mode 100644 index 00000000000000..6f84c556dcfec7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_random_t5_ft_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_random_t5_ft_2_pipeline pipeline T5Transformer from abdiharyadi +author: John Snow Labs +name: burmese_random_t5_ft_2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_random_t5_ft_2_pipeline` is a English model originally trained by abdiharyadi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_random_t5_ft_2_pipeline_en_5.4.2_3.0_1724160624915.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_random_t5_ft_2_pipeline_en_5.4.2_3.0_1724160624915.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_random_t5_ft_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_random_t5_ft_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_random_t5_ft_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|997.6 MB| + +## References + +https://huggingface.co/abdiharyadi/my-random-t5-ft-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_t0_large_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_t0_large_en.md new file mode 100644 index 00000000000000..d1f51a00c5878a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_t0_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_t0_large T5Transformer from qinyuany +author: John Snow Labs +name: burmese_t0_large +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_t0_large` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_t0_large_en_5.4.2_3.0_1724152646755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_t0_large_en_5.4.2_3.0_1724152646755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_t0_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_t0_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_t0_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/qinyuany/my-t0-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-burmese_t0_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-burmese_t0_large_pipeline_en.md new file mode 100644 index 00000000000000..d92f3b7ea5e290 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-burmese_t0_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_t0_large_pipeline pipeline T5Transformer from qinyuany +author: John Snow Labs +name: burmese_t0_large_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_t0_large_pipeline` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_t0_large_pipeline_en_5.4.2_3.0_1724152783372.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_t0_large_pipeline_en_5.4.2_3.0_1724152783372.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_t0_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_t0_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_t0_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/qinyuany/my-t0-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_prompting5_sopal_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_prompting5_sopal_en.md new file mode 100644 index 00000000000000..c04a2c967f6fc9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_prompting5_sopal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_sopal T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_sopal +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_sopal` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_sopal_en_5.4.2_3.0_1724160072227.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_sopal_en_5.4.2_3.0_1724160072227.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_sopal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_sopal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_sopal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_SOPAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_prompting5_sopal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_prompting5_sopal_pipeline_en.md new file mode 100644 index 00000000000000..ec2284fca36269 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_prompting5_sopal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_sopal_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_sopal_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_sopal_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_sopal_pipeline_en_5.4.2_3.0_1724160250270.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_sopal_pipeline_en_5.4.2_3.0_1724160250270.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_sopal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_sopal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_sopal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_SOPAL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_asopl_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_asopl_v1_h1_en.md new file mode 100644 index 00000000000000..a4141af3a71f0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_asopl_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_asopl_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_asopl_v1_h1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_asopl_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_asopl_v1_h1_en_5.4.2_3.0_1724158058412.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_asopl_v1_h1_en_5.4.2_3.0_1724158058412.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_asopl_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_asopl_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_asopl_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_ASOPL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..b6d2c8b813b141 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline_en_5.4.2_3.0_1724158235976.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline_en_5.4.2_3.0_1724158235976.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_asopl_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_ASOPL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_soapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_soapl_v1_en.md new file mode 100644 index 00000000000000..f65caaee609b95 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_soapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_soapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_soapl_v1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_soapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_soapl_v1_en_5.4.2_3.0_1724167113994.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_soapl_v1_en_5.4.2_3.0_1724167113994.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_soapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_soapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_soapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_SOAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline_en.md new file mode 100644 index 00000000000000..6ffae7e490722a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline_en_5.4.2_3.0_1724167290030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline_en_5.4.2_3.0_1724167290030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_soapl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_SOAPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_en.md new file mode 100644 index 00000000000000..37df761febeb28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instructionn4_soapl_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instructionn4_soapl_v1_h1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instructionn4_soapl_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_en_5.4.2_3.0_1724189829645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_en_5.4.2_3.0_1724189829645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instructionn4_soapl_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instructionn4_soapl_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instructionn4_soapl_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_InstructionN4_SOAPL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..5d34df0936ee6d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline_en_5.4.2_3.0_1724190002302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline_en_5.4.2_3.0_1724190002302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instructionn4_soapl_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_InstructionN4_SOAPL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_oaspl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_oaspl_v1_en.md new file mode 100644 index 00000000000000..d67ca21601d31c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_oaspl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_oaspl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_oaspl_v1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_oaspl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oaspl_v1_en_5.4.2_3.0_1724156120854.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oaspl_v1_en_5.4.2_3.0_1724156120854.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_oaspl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_oaspl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_oaspl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OASPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline_en.md new file mode 100644 index 00000000000000..5824402eff250a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline_en_5.4.2_3.0_1724156294136.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline_en_5.4.2_3.0_1724156294136.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_oaspl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OASPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_pasol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_pasol_v1_en.md new file mode 100644 index 00000000000000..59e5445ebeeb48 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_pasol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_pasol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_pasol_v1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_pasol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_pasol_v1_en_5.4.2_3.0_1724172676250.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_pasol_v1_en_5.4.2_3.0_1724172676250.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_pasol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_pasol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_pasol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_PASOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline_en.md new file mode 100644 index 00000000000000..9500d27193eacf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline_en_5.4.2_3.0_1724172847706.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline_en_5.4.2_3.0_1724172847706.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_pasol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_PASOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_spoal_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_spoal_en.md new file mode 100644 index 00000000000000..221e26b33a7a4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_spoal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_spoal T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_spoal +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_spoal` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_spoal_en_5.4.2_3.0_1724171659940.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_spoal_en_5.4.2_3.0_1724171659940.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_spoal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_spoal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_spoal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SPOAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_spoal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_spoal_pipeline_en.md new file mode 100644 index 00000000000000..18f68559e4f2a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instruction0_spoal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_spoal_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_spoal_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_spoal_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_spoal_pipeline_en_5.4.2_3.0_1724171846726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_spoal_pipeline_en_5.4.2_3.0_1724171846726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_spoal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_spoal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_spoal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SPOAL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instructionn4_opsal_v1_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instructionn4_opsal_v1_en.md new file mode 100644 index 00000000000000..3b45ac8575e781 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instructionn4_opsal_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn4_opsal_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn4_opsal_v1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn4_opsal_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_opsal_v1_en_5.4.2_3.0_1724161415832.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_opsal_v1_en_5.4.2_3.0_1724161415832.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn4_opsal_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn4_opsal_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn4_opsal_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN4_OPSAL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline_en.md new file mode 100644 index 00000000000000..8d6e60fb260425 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline_en_5.4.2_3.0_1724161597913.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline_en_5.4.2_3.0_1724161597913.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn4_opsal_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN4_OPSAL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-derm_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-20-derm_t5_small_en.md new file mode 100644 index 00000000000000..4d75e0aac165d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-derm_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English derm_t5_small T5Transformer from neal61 +author: John Snow Labs +name: derm_t5_small +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`derm_t5_small` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/derm_t5_small_en_5.4.2_3.0_1724175295158.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/derm_t5_small_en_5.4.2_3.0_1724175295158.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("derm_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("derm_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|derm_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.5 MB| + +## References + +https://huggingface.co/neal61/derm-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-derm_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-derm_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..57e25547f19c9d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-derm_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English derm_t5_small_pipeline pipeline T5Transformer from neal61 +author: John Snow Labs +name: derm_t5_small_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`derm_t5_small_pipeline` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/derm_t5_small_pipeline_en_5.4.2_3.0_1724175312521.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/derm_t5_small_pipeline_en_5.4.2_3.0_1724175312521.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("derm_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("derm_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|derm_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.6 MB| + +## References + +https://huggingface.co/neal61/derm-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_02_0_5_en.md b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_02_0_5_en.md new file mode 100644 index 00000000000000..3eb8f8025b4a30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_02_0_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_02_0_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_02_0_5 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_02_0_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_0_5_en_5.4.2_3.0_1724184518007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_0_5_en_5.4.2_3.0_1724184518007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_02_0_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_02_0_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_02_0_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.02-0.5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_02_0_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_02_0_5_pipeline_en.md new file mode 100644 index 00000000000000..fd657851dc8fac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_02_0_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_02_0_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_02_0_5_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_02_0_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_0_5_pipeline_en_5.4.2_3.0_1724184709172.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_02_0_5_pipeline_en_5.4.2_3.0_1724184709172.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_02_0_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_02_0_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_02_0_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.02-0.5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_2_1_en.md b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_2_1_en.md new file mode 100644 index 00000000000000..b267da01b0a27a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_2_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_2_1 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_2_1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_2_1` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_1_en_5.4.2_3.0_1724177193540.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_1_en_5.4.2_3.0_1724177193540.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_2_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_2_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_2_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.2-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_2_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_2_1_pipeline_en.md new file mode 100644 index 00000000000000..4c78ec0acb8054 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_0_2_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_2_1_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_2_1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_2_1_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_1_pipeline_en_5.4.2_3.0_1724177380572.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_1_pipeline_en_5.4.2_3.0_1724177380572.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_2_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_2_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_2_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.2-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_b0_05_en.md b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_b0_05_en.md new file mode 100644 index 00000000000000..57eecda3bf74ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_b0_05_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_b0_05 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b0_05 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b0_05` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_05_en_5.4.2_3.0_1724153749319.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_05_en_5.4.2_3.0_1724153749319.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_b0_05","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_b0_05", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b0_05| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b0.05 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_b0_05_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_b0_05_pipeline_en.md new file mode 100644 index 00000000000000..c9b2f4846361a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-distilled_mt5_small_b0_05_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_b0_05_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b0_05_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b0_05_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_05_pipeline_en_5.4.2_3.0_1724153939639.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_05_pipeline_en_5.4.2_3.0_1724153939639.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_b0_05_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_b0_05_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b0_05_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b0.05 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-english_mt5_small_5_wikisql_en.md b/docs/_posts/ahmedlone127/2024-08-20-english_mt5_small_5_wikisql_en.md new file mode 100644 index 00000000000000..3a2c2a61b9ea85 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-english_mt5_small_5_wikisql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_mt5_small_5_wikisql T5Transformer from e22vvb +author: John Snow Labs +name: english_mt5_small_5_wikisql +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mt5_small_5_wikisql` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mt5_small_5_wikisql_en_5.4.2_3.0_1724174745012.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mt5_small_5_wikisql_en_5.4.2_3.0_1724174745012.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_mt5_small_5_wikisql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_mt5_small_5_wikisql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mt5_small_5_wikisql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/e22vvb/EN_mt5-small_5_wikiSQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-english_mt5_small_5_wikisql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-english_mt5_small_5_wikisql_pipeline_en.md new file mode 100644 index 00000000000000..ed33ea1c37746c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-english_mt5_small_5_wikisql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_mt5_small_5_wikisql_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_mt5_small_5_wikisql_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mt5_small_5_wikisql_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mt5_small_5_wikisql_pipeline_en_5.4.2_3.0_1724174918114.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mt5_small_5_wikisql_pipeline_en_5.4.2_3.0_1724174918114.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_mt5_small_5_wikisql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_mt5_small_5_wikisql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mt5_small_5_wikisql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/e22vvb/EN_mt5-small_5_wikiSQL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-english_t5_base_15_spider_nosch_baseline_en.md b/docs/_posts/ahmedlone127/2024-08-20-english_t5_base_15_spider_nosch_baseline_en.md new file mode 100644 index 00000000000000..957ad4e5e3461d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-english_t5_base_15_spider_nosch_baseline_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_t5_base_15_spider_nosch_baseline T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_base_15_spider_nosch_baseline +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_base_15_spider_nosch_baseline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_base_15_spider_nosch_baseline_en_5.4.2_3.0_1724174798934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_base_15_spider_nosch_baseline_en_5.4.2_3.0_1724174798934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_t5_base_15_spider_nosch_baseline","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_t5_base_15_spider_nosch_baseline", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_base_15_spider_nosch_baseline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|973.2 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-base_15_spider_nosch_baseline \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-english_t5_base_15_spider_nosch_baseline_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-english_t5_base_15_spider_nosch_baseline_pipeline_en.md new file mode 100644 index 00000000000000..08b8d5aa51896e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-english_t5_base_15_spider_nosch_baseline_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_t5_base_15_spider_nosch_baseline_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_base_15_spider_nosch_baseline_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_base_15_spider_nosch_baseline_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_base_15_spider_nosch_baseline_pipeline_en_5.4.2_3.0_1724174864114.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_base_15_spider_nosch_baseline_pipeline_en_5.4.2_3.0_1724174864114.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_t5_base_15_spider_nosch_baseline_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_t5_base_15_spider_nosch_baseline_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_base_15_spider_nosch_baseline_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|973.2 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-base_15_spider_nosch_baseline + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-english_t5_small_15_spider_en.md b/docs/_posts/ahmedlone127/2024-08-20-english_t5_small_15_spider_en.md new file mode 100644 index 00000000000000..ce5fb7a9f80213 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-english_t5_small_15_spider_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_t5_small_15_spider T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_small_15_spider +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_small_15_spider` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_small_15_spider_en_5.4.2_3.0_1724192466756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_small_15_spider_en_5.4.2_3.0_1724192466756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_t5_small_15_spider","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_t5_small_15_spider", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_small_15_spider| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.7 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-small_15_spider \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-english_t5_small_15_spider_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-english_t5_small_15_spider_pipeline_en.md new file mode 100644 index 00000000000000..6466d7ff908bd7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-english_t5_small_15_spider_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_t5_small_15_spider_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_small_15_spider_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_small_15_spider_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_small_15_spider_pipeline_en_5.4.2_3.0_1724192488022.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_small_15_spider_pipeline_en_5.4.2_3.0_1724192488022.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_t5_small_15_spider_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_t5_small_15_spider_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_small_15_spider_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.7 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-small_15_spider + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1_en.md b/docs/_posts/ahmedlone127/2024-08-20-false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1_en.md new file mode 100644 index 00000000000000..3899efabb7e4ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1 T5Transformer from tau +author: John Snow Labs +name: false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1` is a English model originally trained by tau. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1_en_5.4.2_3.0_1724194320737.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1_en_5.4.2_3.0_1724194320737.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|false_large_pmi_para0_sent1_span2_ittrue_sargmax_rrfalse_8_1024_0_3_seed2_epoch1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/tau/False_large_pmi_para0_sent1_span2_itTrue_sargmax_rrFalse_8_1024_0.3_seed2_epoch1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-false_large_t5_lm_8_1024_0_15_epoch1_en.md b/docs/_posts/ahmedlone127/2024-08-20-false_large_t5_lm_8_1024_0_15_epoch1_en.md new file mode 100644 index 00000000000000..a509c2631a3bfb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-false_large_t5_lm_8_1024_0_15_epoch1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English false_large_t5_lm_8_1024_0_15_epoch1 T5Transformer from tau +author: John Snow Labs +name: false_large_t5_lm_8_1024_0_15_epoch1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`false_large_t5_lm_8_1024_0_15_epoch1` is a English model originally trained by tau. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/false_large_t5_lm_8_1024_0_15_epoch1_en_5.4.2_3.0_1724189797091.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/false_large_t5_lm_8_1024_0_15_epoch1_en_5.4.2_3.0_1724189797091.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("false_large_t5_lm_8_1024_0_15_epoch1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("false_large_t5_lm_8_1024_0_15_epoch1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|false_large_t5_lm_8_1024_0_15_epoch1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/tau/false_large_t5_lm_8_1024_0.15_epoch1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetune_rugec_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetune_rugec_en.md new file mode 100644 index 00000000000000..0aeda09a1d4bb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetune_rugec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_rugec T5Transformer from mika5883 +author: John Snow Labs +name: finetune_rugec +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_rugec` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_rugec_en_5.4.2_3.0_1724197413542.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_rugec_en_5.4.2_3.0_1724197413542.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_rugec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_rugec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_rugec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/finetune_rugec \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetune_rugec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetune_rugec_pipeline_en.md new file mode 100644 index 00000000000000..54ccb4058998fd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetune_rugec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_rugec_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: finetune_rugec_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_rugec_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_rugec_pipeline_en_5.4.2_3.0_1724197463116.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_rugec_pipeline_en_5.4.2_3.0_1724197463116.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_rugec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_rugec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_rugec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/finetune_rugec + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetune_segmentation_t5_small_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetune_segmentation_t5_small_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..ce7de63ef9394c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetune_segmentation_t5_small_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_segmentation_t5_small_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_segmentation_t5_small_standard_bahasa_cased +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_segmentation_t5_small_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_segmentation_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724186978266.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_segmentation_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724186978266.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_segmentation_t5_small_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_segmentation_t5_small_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_segmentation_t5_small_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mesolitica/finetune-segmentation-t5-small-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetune_segmentation_t5_small_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetune_segmentation_t5_small_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..0e40444aa9e6dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetune_segmentation_t5_small_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_segmentation_t5_small_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_segmentation_t5_small_standard_bahasa_cased_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_segmentation_t5_small_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_segmentation_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724187043716.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_segmentation_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724187043716.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_segmentation_t5_small_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_segmentation_t5_small_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_segmentation_t5_small_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mesolitica/finetune-segmentation-t5-small-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetuned_mt5_mezes_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetuned_mt5_mezes_en.md new file mode 100644 index 00000000000000..fa1b54122d36e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetuned_mt5_mezes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_mt5_mezes T5Transformer from mezes +author: John Snow Labs +name: finetuned_mt5_mezes +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_mt5_mezes` is a English model originally trained by mezes. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_mt5_mezes_en_5.4.2_3.0_1724157572204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_mt5_mezes_en_5.4.2_3.0_1724157572204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_mt5_mezes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_mt5_mezes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_mt5_mezes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/mezes/finetuned-mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetuned_mt5_mezes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetuned_mt5_mezes_pipeline_en.md new file mode 100644 index 00000000000000..7d269c0b6938ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetuned_mt5_mezes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_mt5_mezes_pipeline pipeline T5Transformer from mezes +author: John Snow Labs +name: finetuned_mt5_mezes_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_mt5_mezes_pipeline` is a English model originally trained by mezes. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_mt5_mezes_pipeline_en_5.4.2_3.0_1724157888907.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_mt5_mezes_pipeline_en_5.4.2_3.0_1724157888907.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_mt5_mezes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_mt5_mezes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_mt5_mezes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/mezes/finetuned-mt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_base_palistha_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_base_palistha_en.md new file mode 100644 index 00000000000000..a66b5e12dd1bb5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_base_palistha_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_t5_base_palistha T5Transformer from Palistha +author: John Snow Labs +name: finetuned_t5_base_palistha +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_base_palistha` is a English model originally trained by Palistha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_base_palistha_en_5.4.2_3.0_1724181342618.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_base_palistha_en_5.4.2_3.0_1724181342618.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_t5_base_palistha","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_t5_base_palistha", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_base_palistha| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.4 MB| + +## References + +https://huggingface.co/Palistha/finetuned-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_base_palistha_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_base_palistha_pipeline_en.md new file mode 100644 index 00000000000000..0b744c629cbcc0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_base_palistha_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_t5_base_palistha_pipeline pipeline T5Transformer from Palistha +author: John Snow Labs +name: finetuned_t5_base_palistha_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_base_palistha_pipeline` is a English model originally trained by Palistha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_base_palistha_pipeline_en_5.4.2_3.0_1724181395123.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_base_palistha_pipeline_en_5.4.2_3.0_1724181395123.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_t5_base_palistha_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_t5_base_palistha_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_base_palistha_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.4 MB| + +## References + +https://huggingface.co/Palistha/finetuned-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_small_5_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_small_5_en.md new file mode 100644 index 00000000000000..fc3e8d91eab4df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_small_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_t5_small_5 T5Transformer from Palistha +author: John Snow Labs +name: finetuned_t5_small_5 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_small_5` is a English model originally trained by Palistha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_small_5_en_5.4.2_3.0_1724151383491.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_small_5_en_5.4.2_3.0_1724151383491.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_t5_small_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_t5_small_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_small_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.7 MB| + +## References + +https://huggingface.co/Palistha/finetuned-t5-small-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_small_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_small_5_pipeline_en.md new file mode 100644 index 00000000000000..d985d516deabbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-finetuned_t5_small_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_t5_small_5_pipeline pipeline T5Transformer from Palistha +author: John Snow Labs +name: finetuned_t5_small_5_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_small_5_pipeline` is a English model originally trained by Palistha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_small_5_pipeline_en_5.4.2_3.0_1724151404630.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_small_5_pipeline_en_5.4.2_3.0_1724151404630.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_t5_small_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_t5_small_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_small_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.7 MB| + +## References + +https://huggingface.co/Palistha/finetuned-t5-small-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_6_2_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_6_2_xsum_en.md new file mode 100644 index 00000000000000..9dfa776b439016 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_6_2_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_6_2_xsum T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_6_2_xsum +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_6_2_xsum` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_2_xsum_en_5.4.2_3.0_1724167724293.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_2_xsum_en_5.4.2_3.0_1724167724293.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_6_2_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_6_2_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_6_2_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|736.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-6-2-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_6_2_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_6_2_xsum_pipeline_en.md new file mode 100644 index 00000000000000..c0fb5bcc9a74bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_6_2_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_6_2_xsum_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_6_2_xsum_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_6_2_xsum_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_2_xsum_pipeline_en_5.4.2_3.0_1724167759311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_2_xsum_pipeline_en_5.4.2_3.0_1724167759311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_6_2_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_6_2_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_6_2_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|736.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-6-2-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_analogy_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_analogy_en.md new file mode 100644 index 00000000000000..362b8190d7ef0f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_analogy_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_analogy T5Transformer from research-backup +author: John Snow Labs +name: flan_t5_base_analogy +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_analogy` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_analogy_en_5.4.2_3.0_1724183815652.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_analogy_en_5.4.2_3.0_1724183815652.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_analogy","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_analogy", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_analogy| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/flan-t5-base-analogy \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_analogy_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_analogy_pipeline_en.md new file mode 100644 index 00000000000000..99768a3146639f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_analogy_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_analogy_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: flan_t5_base_analogy_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_analogy_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_analogy_pipeline_en_5.4.2_3.0_1724183865304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_analogy_pipeline_en_5.4.2_3.0_1724183865304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_analogy_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_analogy_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_analogy_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/flan-t5-base-analogy + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_auto_complete_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_auto_complete_en.md new file mode 100644 index 00000000000000..bb6a993c08ca74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_auto_complete_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_auto_complete T5Transformer from silpakanneganti +author: John Snow Labs +name: flan_t5_base_auto_complete +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_auto_complete` is a English model originally trained by silpakanneganti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_auto_complete_en_5.4.2_3.0_1724163071080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_auto_complete_en_5.4.2_3.0_1724163071080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_auto_complete","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_auto_complete", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_auto_complete| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/silpakanneganti/flan-t5-base-auto-complete \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_auto_complete_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_auto_complete_pipeline_en.md new file mode 100644 index 00000000000000..61ace049bea600 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_auto_complete_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_auto_complete_pipeline pipeline T5Transformer from silpakanneganti +author: John Snow Labs +name: flan_t5_base_auto_complete_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_auto_complete_pipeline` is a English model originally trained by silpakanneganti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_auto_complete_pipeline_en_5.4.2_3.0_1724163119455.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_auto_complete_pipeline_en_5.4.2_3.0_1724163119455.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_auto_complete_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_auto_complete_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_auto_complete_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/silpakanneganti/flan-t5-base-auto-complete + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_axh_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_axh_en.md new file mode 100644 index 00000000000000..3feb052738c964 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_axh_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_axh T5Transformer from arrayxhunter +author: John Snow Labs +name: flan_t5_base_axh +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_axh` is a English model originally trained by arrayxhunter. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_axh_en_5.4.2_3.0_1724174748295.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_axh_en_5.4.2_3.0_1724174748295.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_axh","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_axh", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_axh| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/arrayxhunter/flan-t5-base-axh \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_axh_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_axh_pipeline_en.md new file mode 100644 index 00000000000000..52db98831ea89c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_axh_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_axh_pipeline pipeline T5Transformer from arrayxhunter +author: John Snow Labs +name: flan_t5_base_axh_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_axh_pipeline` is a English model originally trained by arrayxhunter. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_axh_pipeline_en_5.4.2_3.0_1724174798560.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_axh_pipeline_en_5.4.2_3.0_1724174798560.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_axh_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_axh_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_axh_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/arrayxhunter/flan-t5-base-axh + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_clang8_e1_b16_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_clang8_e1_b16_en.md new file mode 100644 index 00000000000000..35d9208359f6bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_clang8_e1_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_clang8_e1_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_base_clang8_e1_b16 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_clang8_e1_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_clang8_e1_b16_en_5.4.2_3.0_1724158766238.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_clang8_e1_b16_en_5.4.2_3.0_1724158766238.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_clang8_e1_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_clang8_e1_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_clang8_e1_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-base-clang8-e1-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_clang8_e1_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_clang8_e1_b16_pipeline_en.md new file mode 100644 index 00000000000000..320c0b4451b34d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_clang8_e1_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_clang8_e1_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_base_clang8_e1_b16_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_clang8_e1_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_clang8_e1_b16_pipeline_en_5.4.2_3.0_1724158819746.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_clang8_e1_b16_pipeline_en_5.4.2_3.0_1724158819746.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_clang8_e1_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_clang8_e1_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_clang8_e1_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-base-clang8-e1-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_imdb_text_classification_vyshu2103_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_imdb_text_classification_vyshu2103_en.md new file mode 100644 index 00000000000000..8fb13fe0f16312 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_imdb_text_classification_vyshu2103_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_vyshu2103 T5Transformer from Vyshu2103 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_vyshu2103 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_vyshu2103` is a English model originally trained by Vyshu2103. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_vyshu2103_en_5.4.2_3.0_1724190350230.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_vyshu2103_en_5.4.2_3.0_1724190350230.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_vyshu2103","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_vyshu2103", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_vyshu2103| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Vyshu2103/flan-t5-base-imdb-text-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_imdb_text_classification_vyshu2103_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_imdb_text_classification_vyshu2103_pipeline_en.md new file mode 100644 index 00000000000000..f08a8857c2712e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_imdb_text_classification_vyshu2103_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_vyshu2103_pipeline pipeline T5Transformer from Vyshu2103 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_vyshu2103_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_vyshu2103_pipeline` is a English model originally trained by Vyshu2103. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_vyshu2103_pipeline_en_5.4.2_3.0_1724190398101.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_vyshu2103_pipeline_en_5.4.2_3.0_1724190398101.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_imdb_text_classification_vyshu2103_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_imdb_text_classification_vyshu2103_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_vyshu2103_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Vyshu2103/flan-t5-base-imdb-text-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_interactly_classification_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_interactly_classification_en.md new file mode 100644 index 00000000000000..d3e1e550fffda2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_interactly_classification_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_interactly_classification T5Transformer from silpakanneganti +author: John Snow Labs +name: flan_t5_base_interactly_classification +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_interactly_classification` is a English model originally trained by silpakanneganti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_interactly_classification_en_5.4.2_3.0_1724166474388.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_interactly_classification_en_5.4.2_3.0_1724166474388.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_interactly_classification","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_interactly_classification", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_interactly_classification| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/silpakanneganti/flan-t5-base-interactly-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_interactly_classification_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_interactly_classification_pipeline_en.md new file mode 100644 index 00000000000000..fbc54a5d8628c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_interactly_classification_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_interactly_classification_pipeline pipeline T5Transformer from silpakanneganti +author: John Snow Labs +name: flan_t5_base_interactly_classification_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_interactly_classification_pipeline` is a English model originally trained by silpakanneganti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_interactly_classification_pipeline_en_5.4.2_3.0_1724166522046.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_interactly_classification_pipeline_en_5.4.2_3.0_1724166522046.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_interactly_classification_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_interactly_classification_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_interactly_classification_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/silpakanneganti/flan-t5-base-interactly-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_reviewb_text_classification_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_reviewb_text_classification_en.md new file mode 100644 index 00000000000000..9d7806e7bcf5b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_reviewb_text_classification_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_reviewb_text_classification T5Transformer from sherif1311 +author: John Snow Labs +name: flan_t5_base_reviewb_text_classification +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_reviewb_text_classification` is a English model originally trained by sherif1311. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_reviewb_text_classification_en_5.4.2_3.0_1724155049836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_reviewb_text_classification_en_5.4.2_3.0_1724155049836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_reviewb_text_classification","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_reviewb_text_classification", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_reviewb_text_classification| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sherif1311/flan-t5-base-reviewb-text-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_reviewb_text_classification_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_reviewb_text_classification_pipeline_en.md new file mode 100644 index 00000000000000..6cf87e9cad1724 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_reviewb_text_classification_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_reviewb_text_classification_pipeline pipeline T5Transformer from sherif1311 +author: John Snow Labs +name: flan_t5_base_reviewb_text_classification_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_reviewb_text_classification_pipeline` is a English model originally trained by sherif1311. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_reviewb_text_classification_pipeline_en_5.4.2_3.0_1724155096638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_reviewb_text_classification_pipeline_en_5.4.2_3.0_1724155096638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_reviewb_text_classification_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_reviewb_text_classification_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_reviewb_text_classification_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sherif1311/flan-t5-base-reviewb-text-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_samsum_livin_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_samsum_livin_en.md new file mode 100644 index 00000000000000..79899b21c6f43a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_samsum_livin_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_samsum_livin T5Transformer from Livin +author: John Snow Labs +name: flan_t5_base_samsum_livin +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_livin` is a English model originally trained by Livin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_livin_en_5.4.2_3.0_1724188921432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_livin_en_5.4.2_3.0_1724188921432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_samsum_livin","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_samsum_livin", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_livin| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Livin/flan-t5-base-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_samsum_livin_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_samsum_livin_pipeline_en.md new file mode 100644 index 00000000000000..73be4d0f81c272 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_base_samsum_livin_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_samsum_livin_pipeline pipeline T5Transformer from Livin +author: John Snow Labs +name: flan_t5_base_samsum_livin_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_livin_pipeline` is a English model originally trained by Livin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_livin_pipeline_en_5.4.2_3.0_1724188968314.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_livin_pipeline_en_5.4.2_3.0_1724188968314.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_samsum_livin_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_samsum_livin_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_livin_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Livin/flan-t5-base-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_4_6_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_4_6_cnndm_en.md new file mode 100644 index 00000000000000..890172ad022f54 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_4_6_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_4_6_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_large_4_6_cnndm +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_4_6_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_4_6_cnndm_en_5.4.2_3.0_1724164185534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_4_6_cnndm_en_5.4.2_3.0_1724164185534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_4_6_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_4_6_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_4_6_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-large-4-6-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_4_6_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_4_6_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..d8bd1cdb57dab8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_4_6_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_4_6_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_large_4_6_cnndm_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_4_6_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_4_6_cnndm_pipeline_en_5.4.2_3.0_1724164300901.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_4_6_cnndm_pipeline_en_5.4.2_3.0_1724164300901.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_4_6_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_4_6_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_4_6_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-large-4-6-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large__syntetic_question_answering_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large__syntetic_question_answering_en.md new file mode 100644 index 00000000000000..7d97e6f36f4512 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large__syntetic_question_answering_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large__syntetic_question_answering T5Transformer from lvcalucioli +author: John Snow Labs +name: flan_t5_large__syntetic_question_answering +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large__syntetic_question_answering` is a English model originally trained by lvcalucioli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large__syntetic_question_answering_en_5.4.2_3.0_1724180141785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large__syntetic_question_answering_en_5.4.2_3.0_1724180141785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large__syntetic_question_answering","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large__syntetic_question_answering", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large__syntetic_question_answering| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lvcalucioli/flan-t5-large__syntetic-question-answering \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large__syntetic_question_answering_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large__syntetic_question_answering_pipeline_en.md new file mode 100644 index 00000000000000..1a27fa88e87d4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large__syntetic_question_answering_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large__syntetic_question_answering_pipeline pipeline T5Transformer from lvcalucioli +author: John Snow Labs +name: flan_t5_large__syntetic_question_answering_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large__syntetic_question_answering_pipeline` is a English model originally trained by lvcalucioli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large__syntetic_question_answering_pipeline_en_5.4.2_3.0_1724180282537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large__syntetic_question_answering_pipeline_en_5.4.2_3.0_1724180282537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large__syntetic_question_answering_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large__syntetic_question_answering_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large__syntetic_question_answering_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lvcalucioli/flan-t5-large__syntetic-question-answering + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa_en.md new file mode 100644 index 00000000000000..10f04c79ee94b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa_en_5.4.2_3.0_1724166343700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa_en_5.4.2_3.0_1724166343700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_80_nepal_bhasa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_80-new \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_ep10_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_ep10_en.md new file mode 100644 index 00000000000000..fddc1eb0dba223 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_ep10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_2000_all_ep10 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_2000_all_ep10 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_2000_all_ep10` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_ep10_en_5.4.2_3.0_1724165803886.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_ep10_en_5.4.2_3.0_1724165803886.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_2000_all_ep10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_2000_all_ep10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_2000_all_ep10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_2000-all-ep10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline_en.md new file mode 100644 index 00000000000000..bbd5727dadc4aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline_en_5.4.2_3.0_1724166022799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline_en_5.4.2_3.0_1724166022799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_2000_all_ep10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_2000-all-ep10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_en.md new file mode 100644 index 00000000000000..81e9cea76f76b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_en_5.4.2_3.0_1724197763398.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_en_5.4.2_3.0_1724197763398.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_2000-all-hint_precision-ep10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline_en.md new file mode 100644 index 00000000000000..1f5faf069a1af7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline_en_5.4.2_3.0_1724197909666.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline_en_5.4.2_3.0_1724197909666.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_2000_all_hint_precision_ep10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_2000-all-hint_precision-ep10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_8000_all_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_8000_all_en.md new file mode 100644 index 00000000000000..2bb84914966a6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_8000_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_8000_all T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_8000_all +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_8000_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_8000_all_en_5.4.2_3.0_1724159887421.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_8000_all_en_5.4.2_3.0_1724159887421.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_8000_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_8000_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_8000_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_8000-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_8000_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_8000_all_pipeline_en.md new file mode 100644 index 00000000000000..f4d08e304fda7b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_extraction_cnndm_8000_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_8000_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_8000_all_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_8000_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_8000_all_pipeline_en_5.4.2_3.0_1724160040159.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_8000_all_pipeline_en_5.4.2_3.0_1724160040159.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_8000_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_8000_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_8000_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_8000-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_medistill_28_medsum_ep20_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_medistill_28_medsum_ep20_en.md new file mode 100644 index 00000000000000..36b3fca4260415 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_medistill_28_medsum_ep20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_medistill_28_medsum_ep20 T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_28_medsum_ep20 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_28_medsum_ep20` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_28_medsum_ep20_en_5.4.2_3.0_1724162267933.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_28_medsum_ep20_en_5.4.2_3.0_1724162267933.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_medistill_28_medsum_ep20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_medistill_28_medsum_ep20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_28_medsum_ep20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_28_medsum_ep20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_medistill_28_medsum_ep20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_medistill_28_medsum_ep20_pipeline_en.md new file mode 100644 index 00000000000000..f1b2da28d58739 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_large_medistill_28_medsum_ep20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_medistill_28_medsum_ep20_pipeline pipeline T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_28_medsum_ep20_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_28_medsum_ep20_pipeline` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_28_medsum_ep20_pipeline_en_5.4.2_3.0_1724162416020.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_28_medsum_ep20_pipeline_en_5.4.2_3.0_1724162416020.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_medistill_28_medsum_ep20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_medistill_28_medsum_ep20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_28_medsum_ep20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_28_medsum_ep20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_asap_t4_f3_prompt_adherence_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_asap_t4_f3_prompt_adherence_en.md new file mode 100644 index 00000000000000..99d1320df3c159 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_asap_t4_f3_prompt_adherence_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_asap_t4_f3_prompt_adherence T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t4_f3_prompt_adherence +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t4_f3_prompt_adherence` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t4_f3_prompt_adherence_en_5.4.2_3.0_1724154150592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t4_f3_prompt_adherence_en_5.4.2_3.0_1724154150592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_asap_t4_f3_prompt_adherence","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_asap_t4_f3_prompt_adherence", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t4_f3_prompt_adherence| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t4_f3_prompt_adherence \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_asap_t4_f3_prompt_adherence_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_asap_t4_f3_prompt_adherence_pipeline_en.md new file mode 100644 index 00000000000000..f0258e22c8779d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_asap_t4_f3_prompt_adherence_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_asap_t4_f3_prompt_adherence_pipeline pipeline T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t4_f3_prompt_adherence_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t4_f3_prompt_adherence_pipeline` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t4_f3_prompt_adherence_pipeline_en_5.4.2_3.0_1724154167415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t4_f3_prompt_adherence_pipeline_en_5.4.2_3.0_1724154167415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_asap_t4_f3_prompt_adherence_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_asap_t4_f3_prompt_adherence_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t4_f3_prompt_adherence_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t4_f3_prompt_adherence + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_samsum_sk_2302_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_samsum_sk_2302_en.md new file mode 100644 index 00000000000000..b90587821e7640 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_samsum_sk_2302_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_sk_2302 T5Transformer from sk-2302 +author: John Snow Labs +name: flan_t5_small_samsum_sk_2302 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_sk_2302` is a English model originally trained by sk-2302. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_sk_2302_en_5.4.2_3.0_1724153154493.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_sk_2302_en_5.4.2_3.0_1724153154493.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_sk_2302","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_sk_2302", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_sk_2302| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/sk-2302/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_samsum_sk_2302_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_samsum_sk_2302_pipeline_en.md new file mode 100644 index 00000000000000..3495d189733399 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_small_samsum_sk_2302_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_sk_2302_pipeline pipeline T5Transformer from sk-2302 +author: John Snow Labs +name: flan_t5_small_samsum_sk_2302_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_sk_2302_pipeline` is a English model originally trained by sk-2302. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_sk_2302_pipeline_en_5.4.2_3.0_1724153171471.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_sk_2302_pipeline_en_5.4.2_3.0_1724153171471.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_sk_2302_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_sk_2302_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_sk_2302_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/sk-2302/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_tacred_kongo_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_tacred_kongo_small_finetuned_en.md new file mode 100644 index 00000000000000..4ee0b81c08c8ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_tacred_kongo_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_small_finetuned +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_small_finetuned_en_5.4.2_3.0_1724188719886.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_small_finetuned_en_5.4.2_3.0_1724188719886.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_tacred_kongo_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-flan_t5_tacred_kongo_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_tacred_kongo_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..249143a35027f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-flan_t5_tacred_kongo_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_tacred_kongo_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_tacred_kongo_small_finetuned_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_tacred_kongo_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_small_finetuned_pipeline_en_5.4.2_3.0_1724188736475.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_tacred_kongo_small_finetuned_pipeline_en_5.4.2_3.0_1724188736475.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_tacred_kongo_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_tacred_kongo_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_tacred_kongo_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-tacred-kg-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-french_simplified_en.md b/docs/_posts/ahmedlone127/2024-08-20-french_simplified_en.md new file mode 100644 index 00000000000000..0b067a8f129f2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-french_simplified_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English french_simplified T5Transformer from davidpedem +author: John Snow Labs +name: french_simplified +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`french_simplified` is a English model originally trained by davidpedem. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/french_simplified_en_5.4.2_3.0_1724170479168.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/french_simplified_en_5.4.2_3.0_1724170479168.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("french_simplified","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("french_simplified", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|french_simplified| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/davidpedem/french_simplified \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-french_simplified_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-french_simplified_pipeline_en.md new file mode 100644 index 00000000000000..dabf37a2ac56f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-french_simplified_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English french_simplified_pipeline pipeline T5Transformer from davidpedem +author: John Snow Labs +name: french_simplified_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`french_simplified_pipeline` is a English model originally trained by davidpedem. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/french_simplified_pipeline_en_5.4.2_3.0_1724170527233.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/french_simplified_pipeline_en_5.4.2_3.0_1724170527233.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("french_simplified_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("french_simplified_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|french_simplified_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/davidpedem/french_simplified + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-ft_aeroqa_1hop_c4_20_en.md b/docs/_posts/ahmedlone127/2024-08-20-ft_aeroqa_1hop_c4_20_en.md new file mode 100644 index 00000000000000..12b19a64189057 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-ft_aeroqa_1hop_c4_20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_aeroqa_1hop_c4_20 T5Transformer from sakharamg +author: John Snow Labs +name: ft_aeroqa_1hop_c4_20 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aeroqa_1hop_c4_20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_c4_20_en_5.4.2_3.0_1724162925318.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_c4_20_en_5.4.2_3.0_1724162925318.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_aeroqa_1hop_c4_20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_aeroqa_1hop_c4_20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aeroqa_1hop_c4_20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aeroqa_1hop_c4_20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-ft_aeroqa_1hop_c4_20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-ft_aeroqa_1hop_c4_20_pipeline_en.md new file mode 100644 index 00000000000000..73621d642d1eda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-ft_aeroqa_1hop_c4_20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft_aeroqa_1hop_c4_20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: ft_aeroqa_1hop_c4_20_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aeroqa_1hop_c4_20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_c4_20_pipeline_en_5.4.2_3.0_1724163069492.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_c4_20_pipeline_en_5.4.2_3.0_1724163069492.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft_aeroqa_1hop_c4_20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft_aeroqa_1hop_c4_20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aeroqa_1hop_c4_20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aeroqa_1hop_c4_20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-ft_metaqa_2hop_20_colbert_en.md b/docs/_posts/ahmedlone127/2024-08-20-ft_metaqa_2hop_20_colbert_en.md new file mode 100644 index 00000000000000..aff7e2364889c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-ft_metaqa_2hop_20_colbert_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_metaqa_2hop_20_colbert T5Transformer from sakharamg +author: John Snow Labs +name: ft_metaqa_2hop_20_colbert +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_metaqa_2hop_20_colbert` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_metaqa_2hop_20_colbert_en_5.4.2_3.0_1724174071080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_metaqa_2hop_20_colbert_en_5.4.2_3.0_1724174071080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_metaqa_2hop_20_colbert","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_metaqa_2hop_20_colbert", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_metaqa_2hop_20_colbert| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_metaqa_2hop_20_COLBERT \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-ft_metaqa_2hop_20_colbert_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-ft_metaqa_2hop_20_colbert_pipeline_en.md new file mode 100644 index 00000000000000..b44dd2c55b7730 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-ft_metaqa_2hop_20_colbert_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft_metaqa_2hop_20_colbert_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: ft_metaqa_2hop_20_colbert_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_metaqa_2hop_20_colbert_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_metaqa_2hop_20_colbert_pipeline_en_5.4.2_3.0_1724174212945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_metaqa_2hop_20_colbert_pipeline_en_5.4.2_3.0_1724174212945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft_metaqa_2hop_20_colbert_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft_metaqa_2hop_20_colbert_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_metaqa_2hop_20_colbert_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_metaqa_2hop_20_COLBERT + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-full_train_dev_en.md b/docs/_posts/ahmedlone127/2024-08-20-full_train_dev_en.md new file mode 100644 index 00000000000000..afa51ba2714204 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-full_train_dev_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English full_train_dev T5Transformer from mika5883 +author: John Snow Labs +name: full_train_dev +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`full_train_dev` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/full_train_dev_en_5.4.2_3.0_1724163541597.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/full_train_dev_en_5.4.2_3.0_1724163541597.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("full_train_dev","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("full_train_dev", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|full_train_dev| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/Full_Train_Dev \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-full_train_dev_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-full_train_dev_pipeline_en.md new file mode 100644 index 00000000000000..a36515d209378d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-full_train_dev_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English full_train_dev_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: full_train_dev_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`full_train_dev_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/full_train_dev_pipeline_en_5.4.2_3.0_1724163589139.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/full_train_dev_pipeline_en_5.4.2_3.0_1724163589139.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("full_train_dev_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("full_train_dev_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|full_train_dev_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/Full_Train_Dev + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-german_jeopardy_longt5_large_128_de.md b/docs/_posts/ahmedlone127/2024-08-20-german_jeopardy_longt5_large_128_de.md new file mode 100644 index 00000000000000..51a22b7becff61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-german_jeopardy_longt5_large_128_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German german_jeopardy_longt5_large_128 T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_large_128 +date: 2024-08-20 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_large_128` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_128_de_5.4.2_3.0_1724168503197.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_128_de_5.4.2_3.0_1724168503197.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("german_jeopardy_longt5_large_128","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("german_jeopardy_longt5_large_128", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_large_128| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|3.1 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-large-128 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-german_jeopardy_longt5_large_128_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-20-german_jeopardy_longt5_large_128_pipeline_de.md new file mode 100644 index 00000000000000..beec356bed49d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-german_jeopardy_longt5_large_128_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German german_jeopardy_longt5_large_128_pipeline pipeline T5Transformer from GiantTreeG +author: John Snow Labs +name: german_jeopardy_longt5_large_128_pipeline +date: 2024-08-20 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`german_jeopardy_longt5_large_128_pipeline` is a German model originally trained by GiantTreeG. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_128_pipeline_de_5.4.2_3.0_1724168640157.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/german_jeopardy_longt5_large_128_pipeline_de_5.4.2_3.0_1724168640157.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("german_jeopardy_longt5_large_128_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("german_jeopardy_longt5_large_128_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|german_jeopardy_longt5_large_128_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|3.1 GB| + +## References + +https://huggingface.co/GiantTreeG/german-jeopardy-longt5-large-128 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-goodgletfbasedialogsummaryv1epoch50_en.md b/docs/_posts/ahmedlone127/2024-08-20-goodgletfbasedialogsummaryv1epoch50_en.md new file mode 100644 index 00000000000000..3a7747d607b240 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-goodgletfbasedialogsummaryv1epoch50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English goodgletfbasedialogsummaryv1epoch50 T5Transformer from gvlk +author: John Snow Labs +name: goodgletfbasedialogsummaryv1epoch50 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`goodgletfbasedialogsummaryv1epoch50` is a English model originally trained by gvlk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/goodgletfbasedialogsummaryv1epoch50_en_5.4.2_3.0_1724174265403.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/goodgletfbasedialogsummaryv1epoch50_en_5.4.2_3.0_1724174265403.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("goodgletfbasedialogsummaryv1epoch50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("goodgletfbasedialogsummaryv1epoch50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|goodgletfbasedialogsummaryv1epoch50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|519.0 MB| + +## References + +https://huggingface.co/gvlk/goodgletfbasedialogsummaryv1epoch50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-goodgletfbasedialogsummaryv1epoch50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-goodgletfbasedialogsummaryv1epoch50_pipeline_en.md new file mode 100644 index 00000000000000..61a98d6622b1f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-goodgletfbasedialogsummaryv1epoch50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English goodgletfbasedialogsummaryv1epoch50_pipeline pipeline T5Transformer from gvlk +author: John Snow Labs +name: goodgletfbasedialogsummaryv1epoch50_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`goodgletfbasedialogsummaryv1epoch50_pipeline` is a English model originally trained by gvlk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/goodgletfbasedialogsummaryv1epoch50_pipeline_en_5.4.2_3.0_1724174442337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/goodgletfbasedialogsummaryv1epoch50_pipeline_en_5.4.2_3.0_1724174442337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("goodgletfbasedialogsummaryv1epoch50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("goodgletfbasedialogsummaryv1epoch50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|goodgletfbasedialogsummaryv1epoch50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|519.0 MB| + +## References + +https://huggingface.co/gvlk/goodgletfbasedialogsummaryv1epoch50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_bosnian_v2_en.md b/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_bosnian_v2_en.md new file mode 100644 index 00000000000000..b39e051234da46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_bosnian_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English happy_transformer_t5_base_grammar_correction_bosnian_v2 T5Transformer from hafidikhsan +author: John Snow Labs +name: happy_transformer_t5_base_grammar_correction_bosnian_v2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`happy_transformer_t5_base_grammar_correction_bosnian_v2` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_bosnian_v2_en_5.4.2_3.0_1724152127958.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_bosnian_v2_en_5.4.2_3.0_1724152127958.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("happy_transformer_t5_base_grammar_correction_bosnian_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("happy_transformer_t5_base_grammar_correction_bosnian_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|happy_transformer_t5_base_grammar_correction_bosnian_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hafidikhsan/happy-transformer-t5-base-grammar-correction-bs-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline_en.md new file mode 100644 index 00000000000000..987b279dc7435f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline pipeline T5Transformer from hafidikhsan +author: John Snow Labs +name: happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline_en_5.4.2_3.0_1724152176947.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline_en_5.4.2_3.0_1724152176947.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|happy_transformer_t5_base_grammar_correction_bosnian_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hafidikhsan/happy-transformer-t5-base-grammar-correction-bs-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_lr_v1_en.md b/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_lr_v1_en.md new file mode 100644 index 00000000000000..f9fc350b3b1dd4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_lr_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English happy_transformer_t5_base_grammar_correction_lr_v1 T5Transformer from hafidikhsan +author: John Snow Labs +name: happy_transformer_t5_base_grammar_correction_lr_v1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`happy_transformer_t5_base_grammar_correction_lr_v1` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_lr_v1_en_5.4.2_3.0_1724154716131.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_lr_v1_en_5.4.2_3.0_1724154716131.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("happy_transformer_t5_base_grammar_correction_lr_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("happy_transformer_t5_base_grammar_correction_lr_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|happy_transformer_t5_base_grammar_correction_lr_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hafidikhsan/happy-transformer-t5-base-grammar-correction-lr-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_lr_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_lr_v1_pipeline_en.md new file mode 100644 index 00000000000000..908519cc5fc0e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-happy_transformer_t5_base_grammar_correction_lr_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English happy_transformer_t5_base_grammar_correction_lr_v1_pipeline pipeline T5Transformer from hafidikhsan +author: John Snow Labs +name: happy_transformer_t5_base_grammar_correction_lr_v1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`happy_transformer_t5_base_grammar_correction_lr_v1_pipeline` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_lr_v1_pipeline_en_5.4.2_3.0_1724154765728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_lr_v1_pipeline_en_5.4.2_3.0_1724154765728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("happy_transformer_t5_base_grammar_correction_lr_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("happy_transformer_t5_base_grammar_correction_lr_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|happy_transformer_t5_base_grammar_correction_lr_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hafidikhsan/happy-transformer-t5-base-grammar-correction-lr-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-invariants_model_en.md b/docs/_posts/ahmedlone127/2024-08-20-invariants_model_en.md new file mode 100644 index 00000000000000..9f604255f9ce7e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-invariants_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English invariants_model T5Transformer from sallywww +author: John Snow Labs +name: invariants_model +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`invariants_model` is a English model originally trained by sallywww. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/invariants_model_en_5.4.2_3.0_1724192951300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/invariants_model_en_5.4.2_3.0_1724192951300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("invariants_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("invariants_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|invariants_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.5 MB| + +## References + +https://huggingface.co/sallywww/invariants-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-invariants_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-invariants_model_pipeline_en.md new file mode 100644 index 00000000000000..f7e38914173715 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-invariants_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English invariants_model_pipeline pipeline T5Transformer from sallywww +author: John Snow Labs +name: invariants_model_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`invariants_model_pipeline` is a English model originally trained by sallywww. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/invariants_model_pipeline_en_5.4.2_3.0_1724192972797.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/invariants_model_pipeline_en_5.4.2_3.0_1724192972797.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("invariants_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("invariants_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|invariants_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.5 MB| + +## References + +https://huggingface.co/sallywww/invariants-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-jec_mt5_small_en.md b/docs/_posts/ahmedlone127/2024-08-20-jec_mt5_small_en.md new file mode 100644 index 00000000000000..f2edbce7939b24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-jec_mt5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English jec_mt5_small T5Transformer from HorikawaMegu +author: John Snow Labs +name: jec_mt5_small +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`jec_mt5_small` is a English model originally trained by HorikawaMegu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/jec_mt5_small_en_5.4.2_3.0_1724151921476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/jec_mt5_small_en_5.4.2_3.0_1724151921476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("jec_mt5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("jec_mt5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|jec_mt5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/HorikawaMegu/JEC-mt5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-jec_mt5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-jec_mt5_small_pipeline_en.md new file mode 100644 index 00000000000000..cad5823d1d9397 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-jec_mt5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English jec_mt5_small_pipeline pipeline T5Transformer from HorikawaMegu +author: John Snow Labs +name: jec_mt5_small_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`jec_mt5_small_pipeline` is a English model originally trained by HorikawaMegu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/jec_mt5_small_pipeline_en_5.4.2_3.0_1724152068425.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/jec_mt5_small_pipeline_en_5.4.2_3.0_1724152068425.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("jec_mt5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("jec_mt5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|jec_mt5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/HorikawaMegu/JEC-mt5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-kaggle_freezed_en.md b/docs/_posts/ahmedlone127/2024-08-20-kaggle_freezed_en.md new file mode 100644 index 00000000000000..651c891fe50172 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-kaggle_freezed_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kaggle_freezed T5Transformer from br0hum +author: John Snow Labs +name: kaggle_freezed +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kaggle_freezed` is a English model originally trained by br0hum. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kaggle_freezed_en_5.4.2_3.0_1724166407302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kaggle_freezed_en_5.4.2_3.0_1724166407302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kaggle_freezed","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kaggle_freezed", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kaggle_freezed| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/br0hum/Kaggle-freezed \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-kaggle_freezed_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-kaggle_freezed_pipeline_en.md new file mode 100644 index 00000000000000..682269c8ab66f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-kaggle_freezed_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kaggle_freezed_pipeline pipeline T5Transformer from br0hum +author: John Snow Labs +name: kaggle_freezed_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kaggle_freezed_pipeline` is a English model originally trained by br0hum. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kaggle_freezed_pipeline_en_5.4.2_3.0_1724166457158.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kaggle_freezed_pipeline_en_5.4.2_3.0_1724166457158.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kaggle_freezed_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kaggle_freezed_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kaggle_freezed_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/br0hum/Kaggle-freezed + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_en.md b/docs/_posts/ahmedlone127/2024-08-20-ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_en.md new file mode 100644 index 00000000000000..fae06dc087e4ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9 T5Transformer from datasciathlete +author: John Snow Labs +name: ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9` is a English model originally trained by datasciathlete. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_en_5.4.2_3.0_1724175195457.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_en_5.4.2_3.0_1724175195457.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/datasciathlete/ke-t5-base-aihub-nmt-short-bs8-lr5e5-wd001-e9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline_en.md new file mode 100644 index 00000000000000..2df85ad142a5b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline pipeline T5Transformer from datasciathlete +author: John Snow Labs +name: ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline` is a English model originally trained by datasciathlete. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline_en_5.4.2_3.0_1724175257154.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline_en_5.4.2_3.0_1724175257154.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ke_t5_base_aihub_nmt_short_bs8_lr5e5_wd001_e9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/datasciathlete/ke-t5-base-aihub-nmt-short-bs8-lr5e5-wd001-e9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-kltn_coqe_vit5_ospal_v3_en.md b/docs/_posts/ahmedlone127/2024-08-20-kltn_coqe_vit5_ospal_v3_en.md new file mode 100644 index 00000000000000..5b98a35c3863a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-kltn_coqe_vit5_ospal_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_ospal_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_ospal_v3 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_ospal_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_ospal_v3_en_5.4.2_3.0_1724184809731.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_ospal_v3_en_5.4.2_3.0_1724184809731.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_ospal_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_ospal_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_ospal_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OSPAL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-kltn_coqe_vit5_ospal_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-kltn_coqe_vit5_ospal_v3_pipeline_en.md new file mode 100644 index 00000000000000..9dde1f442bb0b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-kltn_coqe_vit5_ospal_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_ospal_v3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_ospal_v3_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_ospal_v3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_ospal_v3_pipeline_en_5.4.2_3.0_1724184988132.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_ospal_v3_pipeline_en_5.4.2_3.0_1724184988132.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_ospal_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_ospal_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_ospal_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OSPAL_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_finetuned_english_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_finetuned_english_en.md new file mode 100644 index 00000000000000..984c047633d427 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_finetuned_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_cls_finetuned_english T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_finetuned_english +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_finetuned_english` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_english_en_5.4.2_3.0_1724153184333.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_english_en_5.4.2_3.0_1724153184333.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_cls_finetuned_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_cls_finetuned_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_finetuned_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_finetuned_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_finetuned_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_finetuned_english_pipeline_en.md new file mode 100644 index 00000000000000..b020d1036b48b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_finetuned_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_cls_finetuned_english_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_finetuned_english_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_finetuned_english_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_english_pipeline_en_5.4.2_3.0_1724153244682.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_finetuned_english_pipeline_en_5.4.2_3.0_1724153244682.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_cls_finetuned_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_cls_finetuned_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_finetuned_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_finetuned_en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_multitask_swedish_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_multitask_swedish_en.md new file mode 100644 index 00000000000000..18f21584f49085 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_multitask_swedish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_cls_multitask_swedish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_multitask_swedish +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_multitask_swedish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_multitask_swedish_en_5.4.2_3.0_1724189112902.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_multitask_swedish_en_5.4.2_3.0_1724189112902.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_cls_multitask_swedish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_cls_multitask_swedish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_multitask_swedish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_multitask_sv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_multitask_swedish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_multitask_swedish_pipeline_en.md new file mode 100644 index 00000000000000..4dd39c633d2e47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_cls_multitask_swedish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_cls_multitask_swedish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_multitask_swedish_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_multitask_swedish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_multitask_swedish_pipeline_en_5.4.2_3.0_1724189172479.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_multitask_swedish_pipeline_en_5.4.2_3.0_1724189172479.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_cls_multitask_swedish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_cls_multitask_swedish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_multitask_swedish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_multitask_sv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_summ_multitask_italian_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_summ_multitask_italian_en.md new file mode 100644 index 00000000000000..29fd36cc855163 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_summ_multitask_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_summ_multitask_italian T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_multitask_italian +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_multitask_italian` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_italian_en_5.4.2_3.0_1724190537725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_italian_en_5.4.2_3.0_1724190537725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_summ_multitask_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_summ_multitask_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_multitask_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.8 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_multitask_it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_summ_multitask_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_summ_multitask_italian_pipeline_en.md new file mode 100644 index 00000000000000..9996616f5575a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_summ_multitask_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_summ_multitask_italian_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_multitask_italian_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_multitask_italian_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_italian_pipeline_en_5.4.2_3.0_1724190596527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_italian_pipeline_en_5.4.2_3.0_1724190596527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_summ_multitask_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_summ_multitask_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_multitask_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.8 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_multitask_it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_czech_spanish_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_czech_spanish_small_finetuned_en.md new file mode 100644 index 00000000000000..9e66b96cf95df4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_czech_spanish_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_spanish_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_spanish_small_finetuned +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_spanish_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_spanish_small_finetuned_en_5.4.2_3.0_1724174450099.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_spanish_small_finetuned_en_5.4.2_3.0_1724174450099.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_spanish_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_spanish_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_spanish_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_es_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_czech_spanish_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_czech_spanish_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..a1ea43a7c19814 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_czech_spanish_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_spanish_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_spanish_small_finetuned_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_spanish_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_spanish_small_finetuned_pipeline_en_5.4.2_3.0_1724174511311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_spanish_small_finetuned_pipeline_en_5.4.2_3.0_1724174511311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_czech_spanish_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_czech_spanish_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_spanish_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_es_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_german_spanish_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_german_spanish_small_finetuned_en.md new file mode 100644 index 00000000000000..5eec4e8d24bea0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_german_spanish_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_german_spanish_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_spanish_small_finetuned +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_spanish_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_spanish_small_finetuned_en_5.4.2_3.0_1724177354478.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_spanish_small_finetuned_en_5.4.2_3.0_1724177354478.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_german_spanish_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_german_spanish_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_spanish_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_es_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_german_spanish_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_german_spanish_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..8272825a67386a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_german_spanish_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_german_spanish_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_spanish_small_finetuned_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_spanish_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_spanish_small_finetuned_pipeline_en_5.4.2_3.0_1724177414316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_spanish_small_finetuned_pipeline_en_5.4.2_3.0_1724177414316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_german_spanish_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_german_spanish_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_spanish_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_es_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_swedish_czech_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_swedish_czech_small_finetuned_en.md new file mode 100644 index 00000000000000..7faa6d569653c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-legal_t5_small_trans_swedish_czech_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_czech_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_czech_small_finetuned +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_czech_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_czech_small_finetuned_en_5.4.2_3.0_1724150829185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_czech_small_finetuned_en_5.4.2_3.0_1724150829185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_czech_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_czech_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_czech_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_cs_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-littlemkia_en.md b/docs/_posts/ahmedlone127/2024-08-20-littlemkia_en.md new file mode 100644 index 00000000000000..edb1f1e2c95b98 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-littlemkia_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English littlemkia T5Transformer from Stevie23 +author: John Snow Labs +name: littlemkia +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`littlemkia` is a English model originally trained by Stevie23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/littlemkia_en_5.4.2_3.0_1724162617920.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/littlemkia_en_5.4.2_3.0_1724162617920.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("littlemkia","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("littlemkia", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|littlemkia| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Stevie23/LittleMKIA \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-littlemkia_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-littlemkia_pipeline_en.md new file mode 100644 index 00000000000000..f61a04df819de8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-littlemkia_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English littlemkia_pipeline pipeline T5Transformer from Stevie23 +author: John Snow Labs +name: littlemkia_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`littlemkia_pipeline` is a English model originally trained by Stevie23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/littlemkia_pipeline_en_5.4.2_3.0_1724162762628.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/littlemkia_pipeline_en_5.4.2_3.0_1724162762628.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("littlemkia_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("littlemkia_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|littlemkia_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Stevie23/LittleMKIA + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-long_text_unbalanced_smaller_original_text_en.md b/docs/_posts/ahmedlone127/2024-08-20-long_text_unbalanced_smaller_original_text_en.md new file mode 100644 index 00000000000000..a092d46b85a69d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-long_text_unbalanced_smaller_original_text_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_text_unbalanced_smaller_original_text T5Transformer from weny22 +author: John Snow Labs +name: long_text_unbalanced_smaller_original_text +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_text_unbalanced_smaller_original_text` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_text_unbalanced_smaller_original_text_en_5.4.2_3.0_1724195178105.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_text_unbalanced_smaller_original_text_en_5.4.2_3.0_1724195178105.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_text_unbalanced_smaller_original_text","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_text_unbalanced_smaller_original_text", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_text_unbalanced_smaller_original_text| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|403.2 MB| + +## References + +https://huggingface.co/weny22/long_text_unbalanced_smaller_original_text \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-long_text_unbalanced_smaller_original_text_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-long_text_unbalanced_smaller_original_text_pipeline_en.md new file mode 100644 index 00000000000000..c25d0bbf11a189 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-long_text_unbalanced_smaller_original_text_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_text_unbalanced_smaller_original_text_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: long_text_unbalanced_smaller_original_text_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_text_unbalanced_smaller_original_text_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_text_unbalanced_smaller_original_text_pipeline_en_5.4.2_3.0_1724195198448.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_text_unbalanced_smaller_original_text_pipeline_en_5.4.2_3.0_1724195198448.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_text_unbalanced_smaller_original_text_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_text_unbalanced_smaller_original_text_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_text_unbalanced_smaller_original_text_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|403.2 MB| + +## References + +https://huggingface.co/weny22/long_text_unbalanced_smaller_original_text + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-malayalam_sum_v2_en.md b/docs/_posts/ahmedlone127/2024-08-20-malayalam_sum_v2_en.md new file mode 100644 index 00000000000000..d9f97fe142c65b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-malayalam_sum_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English malayalam_sum_v2 T5Transformer from mHossain +author: John Snow Labs +name: malayalam_sum_v2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`malayalam_sum_v2` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/malayalam_sum_v2_en_5.4.2_3.0_1724151404620.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/malayalam_sum_v2_en_5.4.2_3.0_1724151404620.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("malayalam_sum_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("malayalam_sum_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|malayalam_sum_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/ml_sum_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-malayalam_sum_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-malayalam_sum_v2_pipeline_en.md new file mode 100644 index 00000000000000..5791dda6ca09e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-malayalam_sum_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English malayalam_sum_v2_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: malayalam_sum_v2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`malayalam_sum_v2_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/malayalam_sum_v2_pipeline_en_5.4.2_3.0_1724151457292.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/malayalam_sum_v2_pipeline_en_5.4.2_3.0_1724151457292.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("malayalam_sum_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("malayalam_sum_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|malayalam_sum_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/ml_sum_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-math_fully_trained_large_model_en.md b/docs/_posts/ahmedlone127/2024-08-20-math_fully_trained_large_model_en.md new file mode 100644 index 00000000000000..eddf006b7465d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-math_fully_trained_large_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English math_fully_trained_large_model T5Transformer from sammanamgain +author: John Snow Labs +name: math_fully_trained_large_model +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`math_fully_trained_large_model` is a English model originally trained by sammanamgain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/math_fully_trained_large_model_en_5.4.2_3.0_1724161959984.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/math_fully_trained_large_model_en_5.4.2_3.0_1724161959984.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("math_fully_trained_large_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("math_fully_trained_large_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|math_fully_trained_large_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/sammanamgain/Math_fully_trained_large_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-math_fully_trained_large_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-math_fully_trained_large_model_pipeline_en.md new file mode 100644 index 00000000000000..90ceebcdf00880 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-math_fully_trained_large_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English math_fully_trained_large_model_pipeline pipeline T5Transformer from sammanamgain +author: John Snow Labs +name: math_fully_trained_large_model_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`math_fully_trained_large_model_pipeline` is a English model originally trained by sammanamgain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/math_fully_trained_large_model_pipeline_en_5.4.2_3.0_1724162107094.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/math_fully_trained_large_model_pipeline_en_5.4.2_3.0_1724162107094.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("math_fully_trained_large_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("math_fully_trained_large_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|math_fully_trained_large_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/sammanamgain/Math_fully_trained_large_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-md_mt5_1911_v13_en.md b/docs/_posts/ahmedlone127/2024-08-20-md_mt5_1911_v13_en.md new file mode 100644 index 00000000000000..e8719b7b71858c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-md_mt5_1911_v13_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English md_mt5_1911_v13 T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_1911_v13 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_1911_v13` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_1911_v13_en_5.4.2_3.0_1724168688231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_1911_v13_en_5.4.2_3.0_1724168688231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("md_mt5_1911_v13","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("md_mt5_1911_v13", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_1911_v13| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_1911_v13 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-md_mt5_1911_v13_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-md_mt5_1911_v13_pipeline_en.md new file mode 100644 index 00000000000000..bf2429c3f1ae22 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-md_mt5_1911_v13_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English md_mt5_1911_v13_pipeline pipeline T5Transformer from Buseak +author: John Snow Labs +name: md_mt5_1911_v13_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`md_mt5_1911_v13_pipeline` is a English model originally trained by Buseak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/md_mt5_1911_v13_pipeline_en_5.4.2_3.0_1724168833935.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/md_mt5_1911_v13_pipeline_en_5.4.2_3.0_1724168833935.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("md_mt5_1911_v13_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("md_mt5_1911_v13_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|md_mt5_1911_v13_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Buseak/md_mt5_1911_v13 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mixt5forqa_en.md b/docs/_posts/ahmedlone127/2024-08-20-mixt5forqa_en.md new file mode 100644 index 00000000000000..7670cd7fee28f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mixt5forqa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mixt5forqa T5Transformer from dannykm +author: John Snow Labs +name: mixt5forqa +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mixt5forqa` is a English model originally trained by dannykm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mixt5forqa_en_5.4.2_3.0_1724169154645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mixt5forqa_en_5.4.2_3.0_1724169154645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mixt5forqa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mixt5forqa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mixt5forqa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.6 MB| + +## References + +https://huggingface.co/dannykm/MixT5forQA \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mixt5forqa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mixt5forqa_pipeline_en.md new file mode 100644 index 00000000000000..b059757d65edff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mixt5forqa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mixt5forqa_pipeline pipeline T5Transformer from dannykm +author: John Snow Labs +name: mixt5forqa_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mixt5forqa_pipeline` is a English model originally trained by dannykm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mixt5forqa_pipeline_en_5.4.2_3.0_1724169203751.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mixt5forqa_pipeline_en_5.4.2_3.0_1724169203751.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mixt5forqa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mixt5forqa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mixt5forqa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.6 MB| + +## References + +https://huggingface.co/dannykm/MixT5forQA + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-molt5_small_embeddings_en.md b/docs/_posts/ahmedlone127/2024-08-20-molt5_small_embeddings_en.md new file mode 100644 index 00000000000000..dc534f7dd1908b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-molt5_small_embeddings_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English molt5_small_embeddings T5Transformer from octantbio +author: John Snow Labs +name: molt5_small_embeddings +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_small_embeddings` is a English model originally trained by octantbio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_small_embeddings_en_5.4.2_3.0_1724184077161.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_small_embeddings_en_5.4.2_3.0_1724184077161.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("molt5_small_embeddings","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("molt5_small_embeddings", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_small_embeddings| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/octantbio/molt5-small-embeddings \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-molt5_small_embeddings_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-molt5_small_embeddings_pipeline_en.md new file mode 100644 index 00000000000000..afbf3f314c51ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-molt5_small_embeddings_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English molt5_small_embeddings_pipeline pipeline T5Transformer from octantbio +author: John Snow Labs +name: molt5_small_embeddings_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_small_embeddings_pipeline` is a English model originally trained by octantbio. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_small_embeddings_pipeline_en_5.4.2_3.0_1724184093401.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_small_embeddings_pipeline_en_5.4.2_3.0_1724184093401.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("molt5_small_embeddings_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("molt5_small_embeddings_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_small_embeddings_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/octantbio/molt5-small-embeddings + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_en.md new file mode 100644 index 00000000000000..777dc52f4fb83d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base T5Transformer from nestoralvaro +author: John Snow Labs +name: mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base` is a English model originally trained by nestoralvaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_en_5.4.2_3.0_1724174882779.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_en_5.4.2_3.0_1724174882779.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/nestoralvaro/mt5-base-finetuned-xsum-RAW_data_prep_2021_12_26___t55_403.csv__google_mt5_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline_en.md new file mode 100644 index 00000000000000..8d1d7b563770ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline pipeline T5Transformer from nestoralvaro +author: John Snow Labs +name: mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline` is a English model originally trained by nestoralvaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline_en_5.4.2_3.0_1724175388437.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline_en_5.4.2_3.0_1724175388437.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_xsum_raw_data_prep_2021_12_26___t55_403_csv__google_mt5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/nestoralvaro/mt5-base-finetuned-xsum-RAW_data_prep_2021_12_26___t55_403.csv__google_mt5_base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_frquad_ae_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_frquad_ae_pipeline_fr.md new file mode 100644 index 00000000000000..808cd351992c24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_frquad_ae_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_base_frquad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_frquad_ae_pipeline +date: 2024-08-20 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_ae_pipeline` is a French model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_ae_pipeline_fr_5.4.2_3.0_1724195681740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_ae_pipeline_fr_5.4.2_3.0_1724195681740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_frquad_ae_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_frquad_ae_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|2.3 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-frquad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_ende_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_ende_en.md new file mode 100644 index 00000000000000..8cc58160bcc40a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_ende_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_2k_ende T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_2k_ende +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_2k_ende` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_ende_en_5.4.2_3.0_1724175821387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_ende_en_5.4.2_3.0_1724175821387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_2k_ende","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_2k_ende", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_2k_ende| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-2k-ende \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_ende_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_ende_pipeline_en.md new file mode 100644 index 00000000000000..21f116b1ae555c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_ende_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_2k_ende_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_2k_ende_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_2k_ende_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_ende_pipeline_en_5.4.2_3.0_1724176120655.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_ende_pipeline_en_5.4.2_3.0_1724176120655.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_2k_ende_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_2k_ende_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_2k_ende_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-2k-ende + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_enru_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_enru_en.md new file mode 100644 index 00000000000000..fb49c5fff349f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_nc16_2k_enru_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_2k_enru T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_2k_enru +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_2k_enru` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_enru_en_5.4.2_3.0_1724183093478.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_enru_en_5.4.2_3.0_1724183093478.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_2k_enru","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_2k_enru", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_2k_enru| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-2k-enru \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_spanish_qg_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_spanish_qg_en.md new file mode 100644 index 00000000000000..389e495604e1a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_spanish_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_spanish_qg T5Transformer from davidFD19 +author: John Snow Labs +name: mt5_base_spanish_qg +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_spanish_qg` is a English model originally trained by davidFD19. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_qg_en_5.4.2_3.0_1724172353521.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_spanish_qg_en_5.4.2_3.0_1724172353521.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_spanish_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_spanish_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_spanish_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/davidFD19/mt5-base-es-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_trimmed_japanese_90000_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_trimmed_japanese_90000_en.md new file mode 100644 index 00000000000000..03bd350e787e30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_trimmed_japanese_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_japanese_90000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_japanese_90000 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_japanese_90000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_90000_en_5.4.2_3.0_1724189413772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_90000_en_5.4.2_3.0_1724189413772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_japanese_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_japanese_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_japanese_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|777.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ja-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_trimmed_japanese_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_trimmed_japanese_90000_pipeline_en.md new file mode 100644 index 00000000000000..076d28a6de530c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_trimmed_japanese_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_japanese_90000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_japanese_90000_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_japanese_90000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_90000_pipeline_en_5.4.2_3.0_1724189677459.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_90000_pipeline_en_5.4.2_3.0_1724189677459.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_japanese_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_japanese_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_japanese_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|777.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ja-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_v25775_v44105_v65464_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_v25775_v44105_v65464_en.md new file mode 100644 index 00000000000000..7363b5b586c694 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_v25775_v44105_v65464_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_v25775_v44105_v65464 T5Transformer from emilstabil +author: John Snow Labs +name: mt5_base_v25775_v44105_v65464 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_v25775_v44105_v65464` is a English model originally trained by emilstabil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_v25775_v44105_v65464_en_5.4.2_3.0_1724190822801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_v25775_v44105_v65464_en_5.4.2_3.0_1724190822801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_v25775_v44105_v65464","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_v25775_v44105_v65464", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_v25775_v44105_v65464| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/emilstabil/mt5-base_V25775_V44105_V65464 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_base_v25775_v44105_v65464_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_v25775_v44105_v65464_pipeline_en.md new file mode 100644 index 00000000000000..5843c503bd07f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_base_v25775_v44105_v65464_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_v25775_v44105_v65464_pipeline pipeline T5Transformer from emilstabil +author: John Snow Labs +name: mt5_base_v25775_v44105_v65464_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_v25775_v44105_v65464_pipeline` is a English model originally trained by emilstabil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_v25775_v44105_v65464_pipeline_en_5.4.2_3.0_1724190981025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_v25775_v44105_v65464_pipeline_en_5.4.2_3.0_1724190981025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_v25775_v44105_v65464_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_v25775_v44105_v65464_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_v25775_v44105_v65464_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/emilstabil/mt5-base_V25775_V44105_V65464 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_finetuned_amazon_english_spanish_accelerate_lewtun_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_finetuned_amazon_english_spanish_accelerate_lewtun_en.md new file mode 100644 index 00000000000000..ead56a16cd85d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_finetuned_amazon_english_spanish_accelerate_lewtun_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_lewtun T5Transformer from lewtun +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_lewtun +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_lewtun` is a English model originally trained by lewtun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_lewtun_en_5.4.2_3.0_1724196871341.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_lewtun_en_5.4.2_3.0_1724196871341.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_lewtun","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_lewtun", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_lewtun| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lewtun/mt5-finetuned-amazon-en-es-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline_en.md new file mode 100644 index 00000000000000..fba91b599a41db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline pipeline T5Transformer from lewtun +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline` is a English model originally trained by lewtun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline_en_5.4.2_3.0_1724197060697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline_en_5.4.2_3.0_1724197060697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_lewtun_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lewtun/mt5-finetuned-amazon-en-es-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_kogi_regio_ja.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_kogi_regio_ja.md new file mode 100644 index 00000000000000..731e59fb2ba4c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_kogi_regio_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_kogi_regio T5Transformer from kkuramitsu +author: John Snow Labs +name: mt5_kogi_regio +date: 2024-08-20 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_kogi_regio` is a Japanese model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_kogi_regio_ja_5.4.2_3.0_1724166246139.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_kogi_regio_ja_5.4.2_3.0_1724166246139.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_kogi_regio","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_kogi_regio", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_kogi_regio| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|1.2 GB| + +## References + +https://huggingface.co/kkuramitsu/mt5-kogi-regio \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_kogi_regio_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_kogi_regio_pipeline_ja.md new file mode 100644 index 00000000000000..c5e27a241d6c66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_kogi_regio_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_kogi_regio_pipeline pipeline T5Transformer from kkuramitsu +author: John Snow Labs +name: mt5_kogi_regio_pipeline +date: 2024-08-20 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_kogi_regio_pipeline` is a Japanese model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_kogi_regio_pipeline_ja_5.4.2_3.0_1724166438984.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_kogi_regio_pipeline_ja_5.4.2_3.0_1724166438984.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_kogi_regio_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_kogi_regio_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_kogi_regio_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|1.2 GB| + +## References + +https://huggingface.co/kkuramitsu/mt5-kogi-regio + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_lithuanian_simplifier_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_lithuanian_simplifier_en.md new file mode 100644 index 00000000000000..5a988af35a17d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_lithuanian_simplifier_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_lithuanian_simplifier T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_lithuanian_simplifier +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_lithuanian_simplifier` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_lithuanian_simplifier_en_5.4.2_3.0_1724198099622.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_lithuanian_simplifier_en_5.4.2_3.0_1724198099622.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_lithuanian_simplifier","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_lithuanian_simplifier", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_lithuanian_simplifier| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/eglkan1/mT5-lithuanian-simplifier \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_lithuanian_simplifier_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_lithuanian_simplifier_pipeline_en.md new file mode 100644 index 00000000000000..d2d14c1c9d736a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_lithuanian_simplifier_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_lithuanian_simplifier_pipeline pipeline T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_lithuanian_simplifier_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_lithuanian_simplifier_pipeline` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_lithuanian_simplifier_pipeline_en_5.4.2_3.0_1724198282558.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_lithuanian_simplifier_pipeline_en_5.4.2_3.0_1724198282558.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_lithuanian_simplifier_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_lithuanian_simplifier_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_lithuanian_simplifier_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/eglkan1/mT5-lithuanian-simplifier + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_paraphraser_test_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_paraphraser_test_en.md new file mode 100644 index 00000000000000..db99c2c445a00d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_paraphraser_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_paraphraser_test T5Transformer from gregorgabrovsek +author: John Snow Labs +name: mt5_paraphraser_test +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_paraphraser_test` is a English model originally trained by gregorgabrovsek. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_paraphraser_test_en_5.4.2_3.0_1724158136263.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_paraphraser_test_en_5.4.2_3.0_1724158136263.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_paraphraser_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_paraphraser_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_paraphraser_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/gregorgabrovsek/mt5-paraphraser-TEST \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_2_normail_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_2_normail_en.md new file mode 100644 index 00000000000000..6d82d30c47456c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_2_normail_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_2_normail T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: mt5_small_2_normail +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_2_normail` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_2_normail_en_5.4.2_3.0_1724179941266.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_2_normail_en_5.4.2_3.0_1724179941266.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_2_normail","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_2_normail", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_2_normail| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/mt5_small_2-normail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_2_normail_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_2_normail_pipeline_en.md new file mode 100644 index 00000000000000..993e07d514f718 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_2_normail_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_2_normail_pipeline pipeline T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: mt5_small_2_normail_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_2_normail_pipeline` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_2_normail_pipeline_en_5.4.2_3.0_1724180036837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_2_normail_pipeline_en_5.4.2_3.0_1724180036837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_2_normail_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_2_normail_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_2_normail_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/mt5_small_2-normail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_14feb_6_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_14feb_6_en.md new file mode 100644 index 00000000000000..1e896b96c897a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_14feb_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_14feb_6 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_14feb_6 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_14feb_6` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_14feb_6_en_5.4.2_3.0_1724158274160.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_14feb_6_en_5.4.2_3.0_1724158274160.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_14feb_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_14feb_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_14feb_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-14feb-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_14feb_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_14feb_6_pipeline_en.md new file mode 100644 index 00000000000000..1a8aa35a9171b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_14feb_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_14feb_6_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_14feb_6_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_14feb_6_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_14feb_6_pipeline_en_5.4.2_3.0_1724158367868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_14feb_6_pipeline_en_5.4.2_3.0_1724158367868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_14feb_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_14feb_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_14feb_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-14feb-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_german_krylova_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_german_krylova_en.md new file mode 100644 index 00000000000000..99e8d7241fc325 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_german_krylova_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_german_krylova T5Transformer from Krylova +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_german_krylova +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_german_krylova` is a English model originally trained by Krylova. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_krylova_en_5.4.2_3.0_1724194682442.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_krylova_en_5.4.2_3.0_1724194682442.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_german_krylova","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_german_krylova", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_german_krylova| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Krylova/mt5-small-finetuned-amazon-en-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_german_krylova_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_german_krylova_pipeline_en.md new file mode 100644 index 00000000000000..e5196d553ea3f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_german_krylova_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_german_krylova_pipeline pipeline T5Transformer from Krylova +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_german_krylova_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_german_krylova_pipeline` is a English model originally trained by Krylova. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_krylova_pipeline_en_5.4.2_3.0_1724194803013.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_krylova_pipeline_en_5.4.2_3.0_1724194803013.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_german_krylova_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_german_krylova_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_german_krylova_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Krylova/mt5-small-finetuned-amazon-en-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_en.md new file mode 100644 index 00000000000000..f41c3ec7d397d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira T5Transformer from hilariooliveira +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira` is a English model originally trained by hilariooliveira. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_en_5.4.2_3.0_1724153460623.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_en_5.4.2_3.0_1724153460623.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/hilariooliveira/mt5-small-finetuned-amazon-en-es-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline_en.md new file mode 100644 index 00000000000000..eb223a1b14f92c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline pipeline T5Transformer from hilariooliveira +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline` is a English model originally trained by hilariooliveira. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline_en_5.4.2_3.0_1724153606645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline_en_5.4.2_3.0_1724153606645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_accelerate_hilariooliveira_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/hilariooliveira/mt5-small-finetuned-amazon-en-es-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_burakabdi_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_burakabdi_en.md new file mode 100644 index 00000000000000..0dd4ae8ccae282 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_burakabdi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_burakabdi T5Transformer from burakabdi +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_burakabdi +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_burakabdi` is a English model originally trained by burakabdi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_burakabdi_en_5.4.2_3.0_1724157751398.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_burakabdi_en_5.4.2_3.0_1724157751398.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_burakabdi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_burakabdi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_burakabdi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/burakabdi/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline_en.md new file mode 100644 index 00000000000000..9841a5002144ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline pipeline T5Transformer from burakabdi +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline` is a English model originally trained by burakabdi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline_en_5.4.2_3.0_1724157871573.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline_en_5.4.2_3.0_1724157871573.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_burakabdi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/burakabdi/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_hanssh_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_hanssh_en.md new file mode 100644 index 00000000000000..27e33042a49466 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_hanssh_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_hanssh T5Transformer from HanSSH +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_hanssh +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_hanssh` is a English model originally trained by HanSSH. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hanssh_en_5.4.2_3.0_1724155867971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hanssh_en_5.4.2_3.0_1724155867971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_hanssh","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_hanssh", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_hanssh| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/HanSSH/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline_en.md new file mode 100644 index 00000000000000..6cb4f2544a90bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline pipeline T5Transformer from HanSSH +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline` is a English model originally trained by HanSSH. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline_en_5.4.2_3.0_1724155960287.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline_en_5.4.2_3.0_1724155960287.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_hanssh_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/HanSSH/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_jgoodie_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_jgoodie_en.md new file mode 100644 index 00000000000000..0106c2eed7a4d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_jgoodie_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_jgoodie T5Transformer from jgoodie +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_jgoodie +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_jgoodie` is a English model originally trained by jgoodie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jgoodie_en_5.4.2_3.0_1724195807890.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jgoodie_en_5.4.2_3.0_1724195807890.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_jgoodie","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_jgoodie", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_jgoodie| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/jgoodie/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline_en.md new file mode 100644 index 00000000000000..ffe42433219e82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline pipeline T5Transformer from jgoodie +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline` is a English model originally trained by jgoodie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline_en_5.4.2_3.0_1724195905499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline_en_5.4.2_3.0_1724195905499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_jgoodie_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/jgoodie/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_en.md new file mode 100644 index 00000000000000..48b79ad753d6a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti T5Transformer from tanogiorgiutti +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti` is a English model originally trained by tanogiorgiutti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_en_5.4.2_3.0_1724167261845.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_en_5.4.2_3.0_1724167261845.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/tanogiorgiutti/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline_en.md new file mode 100644 index 00000000000000..04b2b5a5ea581e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline pipeline T5Transformer from tanogiorgiutti +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline` is a English model originally trained by tanogiorgiutti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline_en_5.4.2_3.0_1724167360798.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline_en_5.4.2_3.0_1724167360798.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_tanogiorgiutti_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/tanogiorgiutti/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_rabbi_kook_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_rabbi_kook_en.md new file mode 100644 index 00000000000000..bc652e5bc4e2b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_rabbi_kook_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_rabbi_kook T5Transformer from virto +author: John Snow Labs +name: mt5_small_finetuned_rabbi_kook +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_rabbi_kook` is a English model originally trained by virto. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_rabbi_kook_en_5.4.2_3.0_1724173092114.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_rabbi_kook_en_5.4.2_3.0_1724173092114.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_rabbi_kook","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_rabbi_kook", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_rabbi_kook| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/virto/mt5-small-finetuned-rabbi-kook \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_rabbi_kook_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_rabbi_kook_pipeline_en.md new file mode 100644 index 00000000000000..18fe3c8680583e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_finetuned_rabbi_kook_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_rabbi_kook_pipeline pipeline T5Transformer from virto +author: John Snow Labs +name: mt5_small_finetuned_rabbi_kook_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_rabbi_kook_pipeline` is a English model originally trained by virto. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_rabbi_kook_pipeline_en_5.4.2_3.0_1724173217154.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_rabbi_kook_pipeline_en_5.4.2_3.0_1724173217154.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_rabbi_kook_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_rabbi_kook_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_rabbi_kook_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/virto/mt5-small-finetuned-rabbi-kook + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_jaquad_qg_trimmed_japanese_15000_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_jaquad_qg_trimmed_japanese_15000_en.md new file mode 100644 index 00000000000000..04af34bc4f6960 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_jaquad_qg_trimmed_japanese_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_jaquad_qg_trimmed_japanese_15000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qg_trimmed_japanese_15000 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qg_trimmed_japanese_15000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_15000_en_5.4.2_3.0_1724178636414.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_15000_en_5.4.2_3.0_1724178636414.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_jaquad_qg_trimmed_japanese_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_jaquad_qg_trimmed_japanese_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qg_trimmed_japanese_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|251.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qg-trimmed-ja-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline_en.md new file mode 100644 index 00000000000000..3e009a32d5b90d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline_en_5.4.2_3.0_1724178649606.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline_en_5.4.2_3.0_1724178649606.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qg_trimmed_japanese_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|251.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qg-trimmed-ja-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_khmer_10k_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_khmer_10k_en.md new file mode 100644 index 00000000000000..d4322c3ccffc09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_khmer_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_khmer_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_khmer_10k +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_khmer_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_khmer_10k_en_5.4.2_3.0_1724171118525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_khmer_10k_en_5.4.2_3.0_1724171118525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_khmer_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_khmer_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_khmer_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-km-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_khmer_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_khmer_10k_pipeline_en.md new file mode 100644 index 00000000000000..0777657bd7d931 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_khmer_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_khmer_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_khmer_10k_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_khmer_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_khmer_10k_pipeline_en_5.4.2_3.0_1724171287942.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_khmer_10k_pipeline_en_5.4.2_3.0_1724171287942.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_khmer_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_khmer_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_khmer_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-km-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_kook_summary_oriya_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_kook_summary_oriya_en.md new file mode 100644 index 00000000000000..8aeab40b024dab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_kook_summary_oriya_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_kook_summary_oriya T5Transformer from virto +author: John Snow Labs +name: mt5_small_kook_summary_oriya +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_kook_summary_oriya` is a English model originally trained by virto. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_kook_summary_oriya_en_5.4.2_3.0_1724182328985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_kook_summary_oriya_en_5.4.2_3.0_1724182328985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_kook_summary_oriya","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_kook_summary_oriya", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_kook_summary_oriya| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|4.6 MB| + +## References + +https://huggingface.co/virto/mt5-small-kook-summary-or \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_kook_summary_oriya_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_kook_summary_oriya_pipeline_en.md new file mode 100644 index 00000000000000..0e8712d0d89476 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_kook_summary_oriya_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_kook_summary_oriya_pipeline pipeline T5Transformer from virto +author: John Snow Labs +name: mt5_small_kook_summary_oriya_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_kook_summary_oriya_pipeline` is a English model originally trained by virto. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_kook_summary_oriya_pipeline_en_5.4.2_3.0_1724182335300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_kook_summary_oriya_pipeline_en_5.4.2_3.0_1724182335300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_kook_summary_oriya_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_kook_summary_oriya_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_kook_summary_oriya_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|4.6 MB| + +## References + +https://huggingface.co/virto/mt5-small-kook-summary-or + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_koquad_qa_trimmed_korean_15000_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_koquad_qa_trimmed_korean_15000_en.md new file mode 100644 index 00000000000000..ffdf5eaa2a3d3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_koquad_qa_trimmed_korean_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_koquad_qa_trimmed_korean_15000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_koquad_qa_trimmed_korean_15000 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_koquad_qa_trimmed_korean_15000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qa_trimmed_korean_15000_en_5.4.2_3.0_1724158711900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qa_trimmed_korean_15000_en_5.4.2_3.0_1724158711900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_koquad_qa_trimmed_korean_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_koquad_qa_trimmed_korean_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_koquad_qa_trimmed_korean_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|244.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-koquad-qa-trimmed-ko-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_koquad_qa_trimmed_korean_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_koquad_qa_trimmed_korean_15000_pipeline_en.md new file mode 100644 index 00000000000000..c0cccf418aa6a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_koquad_qa_trimmed_korean_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_koquad_qa_trimmed_korean_15000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_koquad_qa_trimmed_korean_15000_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_koquad_qa_trimmed_korean_15000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qa_trimmed_korean_15000_pipeline_en_5.4.2_3.0_1724158725016.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_koquad_qa_trimmed_korean_15000_pipeline_en_5.4.2_3.0_1724158725016.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_koquad_qa_trimmed_korean_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_koquad_qa_trimmed_korean_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_koquad_qa_trimmed_korean_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|244.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-koquad-qa-trimmed-ko-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_mt5_intento2_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_mt5_intento2_en.md new file mode 100644 index 00000000000000..18d881073c15eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_mt5_intento2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_mt5_intento2 T5Transformer from EP9 +author: John Snow Labs +name: mt5_small_mt5_intento2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mt5_intento2` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mt5_intento2_en_5.4.2_3.0_1724156115906.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mt5_intento2_en_5.4.2_3.0_1724156115906.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_mt5_intento2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_mt5_intento2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mt5_intento2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/EP9/mt5-small-MT5-Intento2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_mt5_intento2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_mt5_intento2_pipeline_en.md new file mode 100644 index 00000000000000..a8ad308563d2ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_mt5_intento2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_mt5_intento2_pipeline pipeline T5Transformer from EP9 +author: John Snow Labs +name: mt5_small_mt5_intento2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mt5_intento2_pipeline` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mt5_intento2_pipeline_en_5.4.2_3.0_1724156393596.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mt5_intento2_pipeline_en_5.4.2_3.0_1724156393596.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_mt5_intento2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_mt5_intento2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mt5_intento2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/EP9/mt5-small-MT5-Intento2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_nc16_2k_enes_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_nc16_2k_enes_en.md new file mode 100644 index 00000000000000..f9907ac899348f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_nc16_2k_enes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_2k_enes T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_2k_enes +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_2k_enes` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_2k_enes_en_5.4.2_3.0_1724185605098.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_2k_enes_en_5.4.2_3.0_1724185605098.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_2k_enes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_2k_enes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_2k_enes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-2k-enes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_nc16_2k_enes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_nc16_2k_enes_pipeline_en.md new file mode 100644 index 00000000000000..99819bcaf1bf49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_nc16_2k_enes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_2k_enes_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_2k_enes_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_2k_enes_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_2k_enes_pipeline_en_5.4.2_3.0_1724185801039.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_2k_enes_pipeline_en_5.4.2_3.0_1724185801039.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_2k_enes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_2k_enes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_2k_enes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-2k-enes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_5000_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_5000_en.md new file mode 100644 index 00000000000000..8a5acbf343a95a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_5000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_5000 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_5000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_5000_en_5.4.2_3.0_1724180711100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_5000_en_5.4.2_3.0_1724180711100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian_5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian_5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|196.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru-5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_5000_pipeline_en.md new file mode 100644 index 00000000000000..2ffaee0b99df78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_5000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_5000_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_5000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_5000_pipeline_en_5.4.2_3.0_1724180722754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_5000_pipeline_en_5.4.2_3.0_1724180722754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|196.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru-5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_en.md new file mode 100644 index 00000000000000..5c86b81fde095d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_en_5.4.2_3.0_1724190085087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_en_5.4.2_3.0_1724190085087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|828.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_pipeline_en.md new file mode 100644 index 00000000000000..8065c1b5414c74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_ruquad_qg_trimmed_russian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_pipeline_en_5.4.2_3.0_1724190138803.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_pipeline_en_5.4.2_3.0_1724190138803.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|828.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_summarization_shooterron_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_summarization_shooterron_en.md new file mode 100644 index 00000000000000..7155a240ec8cc3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_summarization_shooterron_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_summarization_shooterron T5Transformer from ShooterRon +author: John Snow Labs +name: mt5_small_summarization_shooterron +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_summarization_shooterron` is a English model originally trained by ShooterRon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_shooterron_en_5.4.2_3.0_1724167248308.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_shooterron_en_5.4.2_3.0_1724167248308.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_summarization_shooterron","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_summarization_shooterron", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_summarization_shooterron| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ShooterRon/mt5-small_summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_summarization_shooterron_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_summarization_shooterron_pipeline_en.md new file mode 100644 index 00000000000000..75c1f8695485f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_summarization_shooterron_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_summarization_shooterron_pipeline pipeline T5Transformer from ShooterRon +author: John Snow Labs +name: mt5_small_summarization_shooterron_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_summarization_shooterron_pipeline` is a English model originally trained by ShooterRon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_shooterron_pipeline_en_5.4.2_3.0_1724167368435.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_summarization_shooterron_pipeline_en_5.4.2_3.0_1724167368435.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_summarization_shooterron_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_summarization_shooterron_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_summarization_shooterron_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ShooterRon/mt5-small_summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_text_sum_4_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_text_sum_4_en.md new file mode 100644 index 00000000000000..5038ba03e26445 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_text_sum_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_text_sum_4 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_text_sum_4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_text_sum_4` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_text_sum_4_en_5.4.2_3.0_1724192641517.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_text_sum_4_en_5.4.2_3.0_1724192641517.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_text_sum_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_text_sum_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_text_sum_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-text-sum-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_text_sum_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_text_sum_4_pipeline_en.md new file mode 100644 index 00000000000000..d50bb9336eaa39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_text_sum_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_text_sum_4_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_text_sum_4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_text_sum_4_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_text_sum_4_pipeline_en_5.4.2_3.0_1724192735824.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_text_sum_4_pipeline_en_5.4.2_3.0_1724192735824.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_text_sum_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_text_sum_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_text_sum_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-text-sum-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_120000_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_120000_en.md new file mode 100644 index 00000000000000..187fef625ca4e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_120000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_120000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_120000 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_120000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_120000_en_5.4.2_3.0_1724194490863.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_120000_en_5.4.2_3.0_1724194490863.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_120000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_120000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_120000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|438.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-120000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_120000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_120000_pipeline_en.md new file mode 100644 index 00000000000000..0264ceabbef2d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_120000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_120000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_120000_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_120000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_120000_pipeline_en_5.4.2_3.0_1724194640752.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_120000_pipeline_en_5.4.2_3.0_1724194640752.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_120000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_120000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_120000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|438.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-120000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_squad_qg_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_squad_qg_en.md new file mode 100644 index 00000000000000..172a5c98991901 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_squad_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_squad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_squad_qg +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_squad_qg` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_squad_qg_en_5.4.2_3.0_1724158518588.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_squad_qg_en_5.4.2_3.0_1724158518588.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_squad_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_squad_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_squad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-squad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_squad_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_squad_qg_pipeline_en.md new file mode 100644 index 00000000000000..144fafe448819c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_english_squad_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_squad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_squad_qg_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_squad_qg_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_squad_qg_pipeline_en_5.4.2_3.0_1724158594941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_squad_qg_pipeline_en_5.4.2_3.0_1724158594941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_squad_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_squad_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_squad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-squad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_french_5000_frquad_qa_fr.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_french_5000_frquad_qa_fr.md new file mode 100644 index 00000000000000..ab4d74683bf7a5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_french_5000_frquad_qa_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_5000_frquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_5000_frquad_qa +date: 2024-08-20 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_5000_frquad_qa` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_frquad_qa_fr_5.4.2_3.0_1724177097514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_frquad_qa_fr_5.4.2_3.0_1724177097514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_5000_frquad_qa","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_5000_frquad_qa", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_5000_frquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|196.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-5000-frquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_french_5000_frquad_qa_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_french_5000_frquad_qa_pipeline_fr.md new file mode 100644 index 00000000000000..2a09befa1b57a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_french_5000_frquad_qa_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_5000_frquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_5000_frquad_qa_pipeline +date: 2024-08-20 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_5000_frquad_qa_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_frquad_qa_pipeline_fr_5.4.2_3.0_1724177107331.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_5000_frquad_qa_pipeline_fr_5.4.2_3.0_1724177107331.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_5000_frquad_qa_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_5000_frquad_qa_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_5000_frquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|196.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-5000-frquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_10000_jaquad_qg_ja.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_10000_jaquad_qg_ja.md new file mode 100644 index 00000000000000..8203441ace69a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_10000_jaquad_qg_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_10000_jaquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_10000_jaquad_qg +date: 2024-08-20 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_10000_jaquad_qg` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_10000_jaquad_qg_ja_5.4.2_3.0_1724155068078.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_10000_jaquad_qg_ja_5.4.2_3.0_1724155068078.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_10000_jaquad_qg","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_10000_jaquad_qg", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_10000_jaquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|223.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-10000-jaquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline_ja.md new file mode 100644 index 00000000000000..eccf7e15ebcff6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline +date: 2024-08-20 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724155079493.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724155079493.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_10000_jaquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|223.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-10000-jaquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_5000_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_5000_en.md new file mode 100644 index 00000000000000..eaf35cb49bcc2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_japanese_5000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_5000 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_5000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_5000_en_5.4.2_3.0_1724189840748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_5000_en_5.4.2_3.0_1724189840748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|101.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_5000_pipeline_en.md new file mode 100644 index 00000000000000..bcae4ac8e91944 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_japanese_5000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_5000_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_5000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_5000_pipeline_en_5.4.2_3.0_1724189875334.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_5000_pipeline_en_5.4.2_3.0_1724189875334.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|101.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_60000_jaquad_qg_ja.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_60000_jaquad_qg_ja.md new file mode 100644 index 00000000000000..513fb01886b8fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_60000_jaquad_qg_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_60000_jaquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_60000_jaquad_qg +date: 2024-08-20 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_60000_jaquad_qg` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_60000_jaquad_qg_ja_5.4.2_3.0_1724151402537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_60000_jaquad_qg_ja_5.4.2_3.0_1724151402537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_60000_jaquad_qg","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_60000_jaquad_qg", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_60000_jaquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|457.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-60000-jaquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline_ja.md new file mode 100644 index 00000000000000..e748b12644d28a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline +date: 2024-08-20 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724151429278.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724151429278.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_60000_jaquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|457.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-60000-jaquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_90000_jaquad_qg_ja.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_90000_jaquad_qg_ja.md new file mode 100644 index 00000000000000..2a889c001088c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_90000_jaquad_qg_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_90000_jaquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_90000_jaquad_qg +date: 2024-08-20 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_90000_jaquad_qg` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_90000_jaquad_qg_ja_5.4.2_3.0_1724194785987.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_90000_jaquad_qg_ja_5.4.2_3.0_1724194785987.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_90000_jaquad_qg","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_90000_jaquad_qg", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_90000_jaquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|581.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-90000-jaquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline_ja.md new file mode 100644 index 00000000000000..3e30dfe47b5000 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline +date: 2024-08-20 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724194821818.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724194821818.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_90000_jaquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|581.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-90000-jaquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_russian_5000_ruquad_qa_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_russian_5000_ruquad_qa_pipeline_ru.md new file mode 100644 index 00000000000000..08eec0b7adacfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_russian_5000_ruquad_qa_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_5000_ruquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_5000_ruquad_qa_pipeline +date: 2024-08-20 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_5000_ruquad_qa_pipeline` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_5000_ruquad_qa_pipeline_ru_5.4.2_3.0_1724195412621.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_5000_ruquad_qa_pipeline_ru_5.4.2_3.0_1724195412621.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_5000_ruquad_qa_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_5000_ruquad_qa_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_5000_ruquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|196.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-5000-ruquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_russian_5000_ruquad_qa_ru.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_russian_5000_ruquad_qa_ru.md new file mode 100644 index 00000000000000..0491694ddbd4bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_trimmed_russian_5000_ruquad_qa_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_5000_ruquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_5000_ruquad_qa +date: 2024-08-20 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_5000_ruquad_qa` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_5000_ruquad_qa_ru_5.4.2_3.0_1724195403069.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_5000_ruquad_qa_ru_5.4.2_3.0_1724195403069.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_5000_ruquad_qa","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_5000_ruquad_qa", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_5000_ruquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|196.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-5000-ruquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_tuto_mt5_small_2_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_tuto_mt5_small_2_en.md new file mode 100644 index 00000000000000..04e80846a449f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_tuto_mt5_small_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_tuto_mt5_small_2 T5Transformer from EP9 +author: John Snow Labs +name: mt5_small_tuto_mt5_small_2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tuto_mt5_small_2` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tuto_mt5_small_2_en_5.4.2_3.0_1724156931300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tuto_mt5_small_2_en_5.4.2_3.0_1724156931300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_tuto_mt5_small_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_tuto_mt5_small_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tuto_mt5_small_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/EP9/mt5-small-tuto-mt5-small-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_small_tuto_mt5_small_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_tuto_mt5_small_2_pipeline_en.md new file mode 100644 index 00000000000000..4de19857605a37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_small_tuto_mt5_small_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_tuto_mt5_small_2_pipeline pipeline T5Transformer from EP9 +author: John Snow Labs +name: mt5_small_tuto_mt5_small_2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tuto_mt5_small_2_pipeline` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tuto_mt5_small_2_pipeline_en_5.4.2_3.0_1724157018837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tuto_mt5_small_2_pipeline_en_5.4.2_3.0_1724157018837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_tuto_mt5_small_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_tuto_mt5_small_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tuto_mt5_small_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/EP9/mt5-small-tuto-mt5-small-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_textsimp_lithuanian_batchsize12_lr5e_5_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_textsimp_lithuanian_batchsize12_lr5e_5_en.md new file mode 100644 index 00000000000000..ab33d4b9756611 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_textsimp_lithuanian_batchsize12_lr5e_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_textsimp_lithuanian_batchsize12_lr5e_5 T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_textsimp_lithuanian_batchsize12_lr5e_5 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_textsimp_lithuanian_batchsize12_lr5e_5` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_textsimp_lithuanian_batchsize12_lr5e_5_en_5.4.2_3.0_1724193463649.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_textsimp_lithuanian_batchsize12_lr5e_5_en_5.4.2_3.0_1724193463649.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_textsimp_lithuanian_batchsize12_lr5e_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_textsimp_lithuanian_batchsize12_lr5e_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_textsimp_lithuanian_batchsize12_lr5e_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|6.0 MB| + +## References + +https://huggingface.co/eglkan1/mT5-TextSimp-LT-BatchSize12-lr5e-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline_en.md new file mode 100644 index 00000000000000..b5f3bcf027f1ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline pipeline T5Transformer from eglkan1 +author: John Snow Labs +name: mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline_en_5.4.2_3.0_1724193473727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline_en_5.4.2_3.0_1724193473727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_textsimp_lithuanian_batchsize12_lr5e_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|6.0 MB| + +## References + +https://huggingface.co/eglkan1/mT5-TextSimp-LT-BatchSize12-lr5e-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_tiny12l_langtype_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_tiny12l_langtype_en.md new file mode 100644 index 00000000000000..bf61dbc1b3b21e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_tiny12l_langtype_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_tiny12l_langtype T5Transformer from artms007 +author: John Snow Labs +name: mt5_tiny12l_langtype +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_tiny12l_langtype` is a English model originally trained by artms007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_tiny12l_langtype_en_5.4.2_3.0_1724192565009.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_tiny12l_langtype_en_5.4.2_3.0_1724192565009.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_tiny12l_langtype","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_tiny12l_langtype", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_tiny12l_langtype| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|212.2 MB| + +## References + +https://huggingface.co/artms007/mt5-tiny12L-langtype \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-mt5_tiny12l_langtype_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-mt5_tiny12l_langtype_pipeline_en.md new file mode 100644 index 00000000000000..24e00794881ad7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-mt5_tiny12l_langtype_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_tiny12l_langtype_pipeline pipeline T5Transformer from artms007 +author: John Snow Labs +name: mt5_tiny12l_langtype_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_tiny12l_langtype_pipeline` is a English model originally trained by artms007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_tiny12l_langtype_pipeline_en_5.4.2_3.0_1724192575077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_tiny12l_langtype_pipeline_en_5.4.2_3.0_1724192575077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_tiny12l_langtype_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_tiny12l_langtype_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_tiny12l_langtype_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|212.2 MB| + +## References + +https://huggingface.co/artms007/mt5-tiny12L-langtype + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_en.md b/docs/_posts/ahmedlone127/2024-08-20-nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_en.md new file mode 100644 index 00000000000000..392a751eb69cb1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64 T5Transformer from meongracun +author: John Snow Labs +name: nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64` is a English model originally trained by meongracun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_en_5.4.2_3.0_1724165501773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_en_5.4.2_3.0_1724165501773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/meongracun/nmt-ted-id-en-lr_1e-2-ep_30-seq_128-bs_64 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline_en.md new file mode 100644 index 00000000000000..f8978fe024f3d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline pipeline T5Transformer from meongracun +author: John Snow Labs +name: nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline` is a English model originally trained by meongracun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline_en_5.4.2_3.0_1724165518887.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline_en_5.4.2_3.0_1724165518887.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nmt_ted_indonesian_english_lr_1e_2_ep_30_seq_128_bosnian_64_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/meongracun/nmt-ted-id-en-lr_1e-2-ep_30-seq_128-bs_64 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-20-normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..14827c5a4769cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_with_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_with_edge_document_level_t5_run2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_with_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724195553941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_en_5.4.2_3.0_1724195553941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_with_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_with_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_with_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|313.6 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_with_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..8539b813c26dc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724195572248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724195572248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|313.6 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_with_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-norwegian_sum_t5_7_en.md b/docs/_posts/ahmedlone127/2024-08-20-norwegian_sum_t5_7_en.md new file mode 100644 index 00000000000000..00352f7fbe1c01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-norwegian_sum_t5_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English norwegian_sum_t5_7 T5Transformer from alraisi +author: John Snow Labs +name: norwegian_sum_t5_7 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_sum_t5_7` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_7_en_5.4.2_3.0_1724196666194.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_7_en_5.4.2_3.0_1724196666194.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("norwegian_sum_t5_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("norwegian_sum_t5_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_sum_t5_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.2 MB| + +## References + +https://huggingface.co/alraisi/no-sum-t5-7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-norwegian_sum_t5_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-norwegian_sum_t5_7_pipeline_en.md new file mode 100644 index 00000000000000..8fdf64216b44b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-norwegian_sum_t5_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English norwegian_sum_t5_7_pipeline pipeline T5Transformer from alraisi +author: John Snow Labs +name: norwegian_sum_t5_7_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_sum_t5_7_pipeline` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_7_pipeline_en_5.4.2_3.0_1724196683951.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_7_pipeline_en_5.4.2_3.0_1724196683951.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("norwegian_sum_t5_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("norwegian_sum_t5_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_sum_t5_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.2 MB| + +## References + +https://huggingface.co/alraisi/no-sum-t5-7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-nsina_headlines_mt5_base_pipeline_si.md b/docs/_posts/ahmedlone127/2024-08-20-nsina_headlines_mt5_base_pipeline_si.md new file mode 100644 index 00000000000000..eaeba9b018da78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-nsina_headlines_mt5_base_pipeline_si.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Sinhala, Sinhalese nsina_headlines_mt5_base_pipeline pipeline T5Transformer from sinhala-nlp +author: John Snow Labs +name: nsina_headlines_mt5_base_pipeline +date: 2024-08-20 +tags: [si, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: si +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nsina_headlines_mt5_base_pipeline` is a Sinhala, Sinhalese model originally trained by sinhala-nlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nsina_headlines_mt5_base_pipeline_si_5.4.2_3.0_1724155221208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nsina_headlines_mt5_base_pipeline_si_5.4.2_3.0_1724155221208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nsina_headlines_mt5_base_pipeline", lang = "si") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nsina_headlines_mt5_base_pipeline", lang = "si") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nsina_headlines_mt5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|si| +|Size:|2.3 GB| + +## References + +https://huggingface.co/sinhala-nlp/NSINA-Headlines-mt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-nsina_headlines_mt5_base_si.md b/docs/_posts/ahmedlone127/2024-08-20-nsina_headlines_mt5_base_si.md new file mode 100644 index 00000000000000..ca914a5a7037ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-nsina_headlines_mt5_base_si.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Sinhala, Sinhalese nsina_headlines_mt5_base T5Transformer from sinhala-nlp +author: John Snow Labs +name: nsina_headlines_mt5_base +date: 2024-08-20 +tags: [si, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: si +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nsina_headlines_mt5_base` is a Sinhala, Sinhalese model originally trained by sinhala-nlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nsina_headlines_mt5_base_si_5.4.2_3.0_1724154938714.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nsina_headlines_mt5_base_si_5.4.2_3.0_1724154938714.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nsina_headlines_mt5_base","si") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nsina_headlines_mt5_base", "si") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nsina_headlines_mt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|si| +|Size:|2.3 GB| + +## References + +https://huggingface.co/sinhala-nlp/NSINA-Headlines-mt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-output_dir_vj99_en.md b/docs/_posts/ahmedlone127/2024-08-20-output_dir_vj99_en.md new file mode 100644 index 00000000000000..704330e4fcbc27 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-output_dir_vj99_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English output_dir_vj99 T5Transformer from vj99 +author: John Snow Labs +name: output_dir_vj99 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`output_dir_vj99` is a English model originally trained by vj99. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/output_dir_vj99_en_5.4.2_3.0_1724192734732.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/output_dir_vj99_en_5.4.2_3.0_1724192734732.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("output_dir_vj99","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("output_dir_vj99", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|output_dir_vj99| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.5 MB| + +## References + +https://huggingface.co/vj99/output_dir \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-output_dir_vj99_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-output_dir_vj99_pipeline_en.md new file mode 100644 index 00000000000000..40434cf53a53e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-output_dir_vj99_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English output_dir_vj99_pipeline pipeline T5Transformer from vj99 +author: John Snow Labs +name: output_dir_vj99_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`output_dir_vj99_pipeline` is a English model originally trained by vj99. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/output_dir_vj99_pipeline_en_5.4.2_3.0_1724192751648.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/output_dir_vj99_pipeline_en_5.4.2_3.0_1724192751648.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("output_dir_vj99_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("output_dir_vj99_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|output_dir_vj99_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.5 MB| + +## References + +https://huggingface.co/vj99/output_dir + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-polish_transliterator_test_en.md b/docs/_posts/ahmedlone127/2024-08-20-polish_transliterator_test_en.md new file mode 100644 index 00000000000000..d30ab6092608b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-polish_transliterator_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English polish_transliterator_test T5Transformer from marcus2000 +author: John Snow Labs +name: polish_transliterator_test +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polish_transliterator_test` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polish_transliterator_test_en_5.4.2_3.0_1724160534108.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polish_transliterator_test_en_5.4.2_3.0_1724160534108.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("polish_transliterator_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("polish_transliterator_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polish_transliterator_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|919.7 MB| + +## References + +https://huggingface.co/marcus2000/polish_transliterator_test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-polish_transliterator_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-polish_transliterator_test_pipeline_en.md new file mode 100644 index 00000000000000..eef5aecac283e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-polish_transliterator_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English polish_transliterator_test_pipeline pipeline T5Transformer from marcus2000 +author: John Snow Labs +name: polish_transliterator_test_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polish_transliterator_test_pipeline` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polish_transliterator_test_pipeline_en_5.4.2_3.0_1724160606453.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polish_transliterator_test_pipeline_en_5.4.2_3.0_1724160606453.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("polish_transliterator_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("polish_transliterator_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polish_transliterator_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|919.7 MB| + +## References + +https://huggingface.co/marcus2000/polish_transliterator_test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-ptt5_xlsumm_cstnews_en.md b/docs/_posts/ahmedlone127/2024-08-20-ptt5_xlsumm_cstnews_en.md new file mode 100644 index 00000000000000..0bc4e1e9ed8afb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-ptt5_xlsumm_cstnews_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ptt5_xlsumm_cstnews T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_xlsumm_cstnews +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_xlsumm_cstnews` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_cstnews_en_5.4.2_3.0_1724186012036.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_cstnews_en_5.4.2_3.0_1724186012036.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_xlsumm_cstnews","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_xlsumm_cstnews", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_xlsumm_cstnews| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.3 MB| + +## References + +https://huggingface.co/arthurmluz/ptt5-xlsumm-cstnews \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-ptt5_xlsumm_cstnews_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-ptt5_xlsumm_cstnews_pipeline_en.md new file mode 100644 index 00000000000000..3a9b749b89cfdc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-ptt5_xlsumm_cstnews_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ptt5_xlsumm_cstnews_pipeline pipeline T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_xlsumm_cstnews_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_xlsumm_cstnews_pipeline` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_cstnews_pipeline_en_5.4.2_3.0_1724186065563.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_cstnews_pipeline_en_5.4.2_3.0_1724186065563.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_xlsumm_cstnews_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_xlsumm_cstnews_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_xlsumm_cstnews_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.3 MB| + +## References + +https://huggingface.co/arthurmluz/ptt5-xlsumm-cstnews + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-qa_squad_en.md b/docs/_posts/ahmedlone127/2024-08-20-qa_squad_en.md new file mode 100644 index 00000000000000..972669f5776a40 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-qa_squad_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qa_squad T5Transformer from SamuelMiller +author: John Snow Labs +name: qa_squad +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qa_squad` is a English model originally trained by SamuelMiller. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qa_squad_en_5.4.2_3.0_1724174188995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qa_squad_en_5.4.2_3.0_1724174188995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qa_squad","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qa_squad", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qa_squad| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.8 MB| + +## References + +https://huggingface.co/SamuelMiller/qa_squad \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-qa_squad_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-qa_squad_pipeline_en.md new file mode 100644 index 00000000000000..01d1d43f3a3980 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-qa_squad_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qa_squad_pipeline pipeline T5Transformer from SamuelMiller +author: John Snow Labs +name: qa_squad_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qa_squad_pipeline` is a English model originally trained by SamuelMiller. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qa_squad_pipeline_en_5.4.2_3.0_1724174206354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qa_squad_pipeline_en_5.4.2_3.0_1724174206354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qa_squad_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qa_squad_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qa_squad_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.8 MB| + +## References + +https://huggingface.co/SamuelMiller/qa_squad + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-qcpg_mscoco_bleurt_lr1e_4_en.md b/docs/_posts/ahmedlone127/2024-08-20-qcpg_mscoco_bleurt_lr1e_4_en.md new file mode 100644 index 00000000000000..85a141551325b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-qcpg_mscoco_bleurt_lr1e_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qcpg_mscoco_bleurt_lr1e_4 T5Transformer from madhavsankar +author: John Snow Labs +name: qcpg_mscoco_bleurt_lr1e_4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qcpg_mscoco_bleurt_lr1e_4` is a English model originally trained by madhavsankar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qcpg_mscoco_bleurt_lr1e_4_en_5.4.2_3.0_1724153225192.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qcpg_mscoco_bleurt_lr1e_4_en_5.4.2_3.0_1724153225192.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qcpg_mscoco_bleurt_lr1e_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qcpg_mscoco_bleurt_lr1e_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qcpg_mscoco_bleurt_lr1e_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/madhavsankar/qcpg-mscoco-bleurt-lr1e-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-qcpg_mscoco_bleurt_lr1e_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-qcpg_mscoco_bleurt_lr1e_4_pipeline_en.md new file mode 100644 index 00000000000000..b66b6d5ee3a960 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-qcpg_mscoco_bleurt_lr1e_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qcpg_mscoco_bleurt_lr1e_4_pipeline pipeline T5Transformer from madhavsankar +author: John Snow Labs +name: qcpg_mscoco_bleurt_lr1e_4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qcpg_mscoco_bleurt_lr1e_4_pipeline` is a English model originally trained by madhavsankar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qcpg_mscoco_bleurt_lr1e_4_pipeline_en_5.4.2_3.0_1724153273220.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qcpg_mscoco_bleurt_lr1e_4_pipeline_en_5.4.2_3.0_1724153273220.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qcpg_mscoco_bleurt_lr1e_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qcpg_mscoco_bleurt_lr1e_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qcpg_mscoco_bleurt_lr1e_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/madhavsankar/qcpg-mscoco-bleurt-lr1e-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-qg_t5_base_squad_en.md b/docs/_posts/ahmedlone127/2024-08-20-qg_t5_base_squad_en.md new file mode 100644 index 00000000000000..d755d0268ce11e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-qg_t5_base_squad_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qg_t5_base_squad T5Transformer from xiaothung +author: John Snow Labs +name: qg_t5_base_squad +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qg_t5_base_squad` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qg_t5_base_squad_en_5.4.2_3.0_1724183031270.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qg_t5_base_squad_en_5.4.2_3.0_1724183031270.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qg_t5_base_squad","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qg_t5_base_squad", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qg_t5_base_squad| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/qg-t5-base-squad \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-qg_t5_base_squad_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-qg_t5_base_squad_pipeline_en.md new file mode 100644 index 00000000000000..aa975ef8323b67 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-qg_t5_base_squad_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qg_t5_base_squad_pipeline pipeline T5Transformer from xiaothung +author: John Snow Labs +name: qg_t5_base_squad_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qg_t5_base_squad_pipeline` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qg_t5_base_squad_pipeline_en_5.4.2_3.0_1724183079645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qg_t5_base_squad_pipeline_en_5.4.2_3.0_1724183079645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qg_t5_base_squad_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qg_t5_base_squad_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qg_t5_base_squad_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/qg-t5-base-squad + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-real_prompt_100v3_500syn_all_gen_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-20-real_prompt_100v3_500syn_all_gen_t5_base_en.md new file mode 100644 index 00000000000000..71152b2b2faa24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-real_prompt_100v3_500syn_all_gen_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English real_prompt_100v3_500syn_all_gen_t5_base T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_100v3_500syn_all_gen_t5_base +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_100v3_500syn_all_gen_t5_base` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_100v3_500syn_all_gen_t5_base_en_5.4.2_3.0_1724181629606.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_100v3_500syn_all_gen_t5_base_en_5.4.2_3.0_1724181629606.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("real_prompt_100v3_500syn_all_gen_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("real_prompt_100v3_500syn_all_gen_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_100v3_500syn_all_gen_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-100V3-500syn-all-gen-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-real_prompt_100v3_500syn_all_gen_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-real_prompt_100v3_500syn_all_gen_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..8561eaf7ce9cc9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-real_prompt_100v3_500syn_all_gen_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English real_prompt_100v3_500syn_all_gen_t5_base_pipeline pipeline T5Transformer from ShokSmile +author: John Snow Labs +name: real_prompt_100v3_500syn_all_gen_t5_base_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`real_prompt_100v3_500syn_all_gen_t5_base_pipeline` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/real_prompt_100v3_500syn_all_gen_t5_base_pipeline_en_5.4.2_3.0_1724181678667.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/real_prompt_100v3_500syn_all_gen_t5_base_pipeline_en_5.4.2_3.0_1724181678667.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("real_prompt_100v3_500syn_all_gen_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("real_prompt_100v3_500syn_all_gen_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|real_prompt_100v3_500syn_all_gen_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShokSmile/real-prompt-100V3-500syn-all-gen-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-results_shishckova_en.md b/docs/_posts/ahmedlone127/2024-08-20-results_shishckova_en.md new file mode 100644 index 00000000000000..d570fa19093cee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-results_shishckova_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English results_shishckova T5Transformer from ShishckovA +author: John Snow Labs +name: results_shishckova +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_shishckova` is a English model originally trained by ShishckovA. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_shishckova_en_5.4.2_3.0_1724153087525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_shishckova_en_5.4.2_3.0_1724153087525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("results_shishckova","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("results_shishckova", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_shishckova| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.5 MB| + +## References + +https://huggingface.co/ShishckovA/results \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-results_shishckova_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-results_shishckova_pipeline_en.md new file mode 100644 index 00000000000000..e2b3096407195b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-results_shishckova_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English results_shishckova_pipeline pipeline T5Transformer from ShishckovA +author: John Snow Labs +name: results_shishckova_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_shishckova_pipeline` is a English model originally trained by ShishckovA. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_shishckova_pipeline_en_5.4.2_3.0_1724153104600.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_shishckova_pipeline_en_5.4.2_3.0_1724153104600.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("results_shishckova_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("results_shishckova_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_shishckova_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.5 MB| + +## References + +https://huggingface.co/ShishckovA/results + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-rulec_gpt_en.md b/docs/_posts/ahmedlone127/2024-08-20-rulec_gpt_en.md new file mode 100644 index 00000000000000..3e2422a6766a8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-rulec_gpt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rulec_gpt T5Transformer from mika5883 +author: John Snow Labs +name: rulec_gpt +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rulec_gpt` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rulec_gpt_en_5.4.2_3.0_1724151749438.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rulec_gpt_en_5.4.2_3.0_1724151749438.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rulec_gpt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rulec_gpt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rulec_gpt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/RULEC_GPT \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-rulec_gpt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-rulec_gpt_pipeline_en.md new file mode 100644 index 00000000000000..51659a790b4420 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-rulec_gpt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rulec_gpt_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: rulec_gpt_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rulec_gpt_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rulec_gpt_pipeline_en_5.4.2_3.0_1724151798238.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rulec_gpt_pipeline_en_5.4.2_3.0_1724151798238.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rulec_gpt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rulec_gpt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rulec_gpt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/RULEC_GPT + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-rut5_base_detox_hw_en.md b/docs/_posts/ahmedlone127/2024-08-20-rut5_base_detox_hw_en.md new file mode 100644 index 00000000000000..014cf6fbb19b65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-rut5_base_detox_hw_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_detox_hw T5Transformer from PolarNight +author: John Snow Labs +name: rut5_base_detox_hw +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_detox_hw` is a English model originally trained by PolarNight. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_detox_hw_en_5.4.2_3.0_1724163692123.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_detox_hw_en_5.4.2_3.0_1724163692123.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_detox_hw","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_detox_hw", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_detox_hw| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PolarNight/rut5-base-detox-hw \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-rut5_base_detox_hw_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-rut5_base_detox_hw_pipeline_en.md new file mode 100644 index 00000000000000..d6099cc6505d69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-rut5_base_detox_hw_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_detox_hw_pipeline pipeline T5Transformer from PolarNight +author: John Snow Labs +name: rut5_base_detox_hw_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_detox_hw_pipeline` is a English model originally trained by PolarNight. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_detox_hw_pipeline_en_5.4.2_3.0_1724163738879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_detox_hw_pipeline_en_5.4.2_3.0_1724163738879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_detox_hw_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_detox_hw_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_detox_hw_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PolarNight/rut5-base-detox-hw + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-sapol_coqe_vit5_en.md b/docs/_posts/ahmedlone127/2024-08-20-sapol_coqe_vit5_en.md new file mode 100644 index 00000000000000..c657fcc77f02d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-sapol_coqe_vit5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sapol_coqe_vit5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: sapol_coqe_vit5 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sapol_coqe_vit5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sapol_coqe_vit5_en_5.4.2_3.0_1724170753350.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sapol_coqe_vit5_en_5.4.2_3.0_1724170753350.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sapol_coqe_vit5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sapol_coqe_vit5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sapol_coqe_vit5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/SAPOL_COQE_viT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-sapol_coqe_vit5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-sapol_coqe_vit5_pipeline_en.md new file mode 100644 index 00000000000000..3b9fad41789ae8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-sapol_coqe_vit5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sapol_coqe_vit5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: sapol_coqe_vit5_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sapol_coqe_vit5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sapol_coqe_vit5_pipeline_en_5.4.2_3.0_1724170932420.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sapol_coqe_vit5_pipeline_en_5.4.2_3.0_1724170932420.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sapol_coqe_vit5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sapol_coqe_vit5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sapol_coqe_vit5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/SAPOL_COQE_viT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-scifive_pubmedqa_question_generation_nmconcept_en.md b/docs/_posts/ahmedlone127/2024-08-20-scifive_pubmedqa_question_generation_nmconcept_en.md new file mode 100644 index 00000000000000..bd163fd72fa1ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-scifive_pubmedqa_question_generation_nmconcept_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English scifive_pubmedqa_question_generation_nmconcept T5Transformer from frozenwalker +author: John Snow Labs +name: scifive_pubmedqa_question_generation_nmconcept +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_pubmedqa_question_generation_nmconcept` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_nmconcept_en_5.4.2_3.0_1724185057462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_nmconcept_en_5.4.2_3.0_1724185057462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("scifive_pubmedqa_question_generation_nmconcept","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("scifive_pubmedqa_question_generation_nmconcept", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_pubmedqa_question_generation_nmconcept| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/SciFive_pubmedqa_question_generation_nmconcept \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-scifive_pubmedqa_question_generation_nmconcept_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-scifive_pubmedqa_question_generation_nmconcept_pipeline_en.md new file mode 100644 index 00000000000000..843dec598b1e90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-scifive_pubmedqa_question_generation_nmconcept_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English scifive_pubmedqa_question_generation_nmconcept_pipeline pipeline T5Transformer from frozenwalker +author: John Snow Labs +name: scifive_pubmedqa_question_generation_nmconcept_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_pubmedqa_question_generation_nmconcept_pipeline` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_nmconcept_pipeline_en_5.4.2_3.0_1724185107289.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_nmconcept_pipeline_en_5.4.2_3.0_1724185107289.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("scifive_pubmedqa_question_generation_nmconcept_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("scifive_pubmedqa_question_generation_nmconcept_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_pubmedqa_question_generation_nmconcept_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/SciFive_pubmedqa_question_generation_nmconcept + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-self_trained_modelst5_large_finetuned_epoch20_en.md b/docs/_posts/ahmedlone127/2024-08-20-self_trained_modelst5_large_finetuned_epoch20_en.md new file mode 100644 index 00000000000000..33664159589e72 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-self_trained_modelst5_large_finetuned_epoch20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English self_trained_modelst5_large_finetuned_epoch20 T5Transformer from Yongchao1203 +author: John Snow Labs +name: self_trained_modelst5_large_finetuned_epoch20 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`self_trained_modelst5_large_finetuned_epoch20` is a English model originally trained by Yongchao1203. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/self_trained_modelst5_large_finetuned_epoch20_en_5.4.2_3.0_1724188049550.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/self_trained_modelst5_large_finetuned_epoch20_en_5.4.2_3.0_1724188049550.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("self_trained_modelst5_large_finetuned_epoch20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("self_trained_modelst5_large_finetuned_epoch20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|self_trained_modelst5_large_finetuned_epoch20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/Yongchao1203/self_trained_modelst5-large-finetuned-epoch20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-self_trained_modelst5_large_finetuned_epoch20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-self_trained_modelst5_large_finetuned_epoch20_pipeline_en.md new file mode 100644 index 00000000000000..efd9962e1aa81a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-self_trained_modelst5_large_finetuned_epoch20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English self_trained_modelst5_large_finetuned_epoch20_pipeline pipeline T5Transformer from Yongchao1203 +author: John Snow Labs +name: self_trained_modelst5_large_finetuned_epoch20_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`self_trained_modelst5_large_finetuned_epoch20_pipeline` is a English model originally trained by Yongchao1203. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/self_trained_modelst5_large_finetuned_epoch20_pipeline_en_5.4.2_3.0_1724188548560.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/self_trained_modelst5_large_finetuned_epoch20_pipeline_en_5.4.2_3.0_1724188548560.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("self_trained_modelst5_large_finetuned_epoch20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("self_trained_modelst5_large_finetuned_epoch20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|self_trained_modelst5_large_finetuned_epoch20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/Yongchao1203/self_trained_modelst5-large-finetuned-epoch20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-semeval2023_clickbait_flan_t5_large_seed47_en.md b/docs/_posts/ahmedlone127/2024-08-20-semeval2023_clickbait_flan_t5_large_seed47_en.md new file mode 100644 index 00000000000000..6f686a0eb9a60d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-semeval2023_clickbait_flan_t5_large_seed47_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English semeval2023_clickbait_flan_t5_large_seed47 T5Transformer from tohokunlp-semeval2023-clickbait +author: John Snow Labs +name: semeval2023_clickbait_flan_t5_large_seed47 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`semeval2023_clickbait_flan_t5_large_seed47` is a English model originally trained by tohokunlp-semeval2023-clickbait. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/semeval2023_clickbait_flan_t5_large_seed47_en_5.4.2_3.0_1724185898342.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/semeval2023_clickbait_flan_t5_large_seed47_en_5.4.2_3.0_1724185898342.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("semeval2023_clickbait_flan_t5_large_seed47","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("semeval2023_clickbait_flan_t5_large_seed47", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|semeval2023_clickbait_flan_t5_large_seed47| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/tohokunlp-semeval2023-clickbait/semeval2023-clickbait-flan-t5-large-seed47 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-semeval2023_clickbait_flan_t5_large_seed47_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-semeval2023_clickbait_flan_t5_large_seed47_pipeline_en.md new file mode 100644 index 00000000000000..9255ef1b5c1d6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-semeval2023_clickbait_flan_t5_large_seed47_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English semeval2023_clickbait_flan_t5_large_seed47_pipeline pipeline T5Transformer from tohokunlp-semeval2023-clickbait +author: John Snow Labs +name: semeval2023_clickbait_flan_t5_large_seed47_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`semeval2023_clickbait_flan_t5_large_seed47_pipeline` is a English model originally trained by tohokunlp-semeval2023-clickbait. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/semeval2023_clickbait_flan_t5_large_seed47_pipeline_en_5.4.2_3.0_1724186036680.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/semeval2023_clickbait_flan_t5_large_seed47_pipeline_en_5.4.2_3.0_1724186036680.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("semeval2023_clickbait_flan_t5_large_seed47_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("semeval2023_clickbait_flan_t5_large_seed47_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|semeval2023_clickbait_flan_t5_large_seed47_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/tohokunlp-semeval2023-clickbait/semeval2023-clickbait-flan-t5-large-seed47 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_en.md b/docs/_posts/ahmedlone127/2024-08-20-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_en.md new file mode 100644 index 00000000000000..c5108ea6d9f153 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_en_5.4.2_3.0_1724176971038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_en_5.4.2_3.0_1724176971038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|312.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run1_checking_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline_en.md new file mode 100644 index 00000000000000..d673a0e18d001f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline_en_5.4.2_3.0_1724176989148.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline_en_5.4.2_3.0_1724176989148.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_normal_graphs_with_edge_document_level_t5_run1_checking_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|312.1 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_normal_graphs_with_edge_document_level_T5_run1_checking_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-speller_t5_88_en.md b/docs/_posts/ahmedlone127/2024-08-20-speller_t5_88_en.md new file mode 100644 index 00000000000000..b4e6e7505d07ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-speller_t5_88_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_88 T5Transformer from summervent +author: John Snow Labs +name: speller_t5_88 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_88` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_88_en_5.4.2_3.0_1724184279532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_88_en_5.4.2_3.0_1724184279532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_88","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_88", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_88| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-88 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-speller_t5_88_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-speller_t5_88_pipeline_en.md new file mode 100644 index 00000000000000..ff22970a22d41f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-speller_t5_88_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_88_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_88_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_88_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_88_pipeline_en_5.4.2_3.0_1724184329009.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_88_pipeline_en_5.4.2_3.0_1724184329009.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_88_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_88_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_88_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-88 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-storri_summarizer_en.md b/docs/_posts/ahmedlone127/2024-08-20-storri_summarizer_en.md new file mode 100644 index 00000000000000..5b905e04f5bdd5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-storri_summarizer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English storri_summarizer T5Transformer from leumastai +author: John Snow Labs +name: storri_summarizer +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`storri_summarizer` is a English model originally trained by leumastai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/storri_summarizer_en_5.4.2_3.0_1724170014095.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/storri_summarizer_en_5.4.2_3.0_1724170014095.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("storri_summarizer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("storri_summarizer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|storri_summarizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.0 MB| + +## References + +https://huggingface.co/leumastai/storri-summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-storri_summarizer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-storri_summarizer_pipeline_en.md new file mode 100644 index 00000000000000..8ca6f802f4f739 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-storri_summarizer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English storri_summarizer_pipeline pipeline T5Transformer from leumastai +author: John Snow Labs +name: storri_summarizer_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`storri_summarizer_pipeline` is a English model originally trained by leumastai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/storri_summarizer_pipeline_en_5.4.2_3.0_1724170041593.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/storri_summarizer_pipeline_en_5.4.2_3.0_1724170041593.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("storri_summarizer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("storri_summarizer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|storri_summarizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|325.0 MB| + +## References + +https://huggingface.co/leumastai/storri-summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-subsec_t5_french_30k_en.md b/docs/_posts/ahmedlone127/2024-08-20-subsec_t5_french_30k_en.md new file mode 100644 index 00000000000000..90d44f5aed7c3a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-subsec_t5_french_30k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English subsec_t5_french_30k T5Transformer from homersimpson +author: John Snow Labs +name: subsec_t5_french_30k +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`subsec_t5_french_30k` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/subsec_t5_french_30k_en_5.4.2_3.0_1724173020877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/subsec_t5_french_30k_en_5.4.2_3.0_1724173020877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("subsec_t5_french_30k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("subsec_t5_french_30k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|subsec_t5_french_30k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|511.6 MB| + +## References + +https://huggingface.co/homersimpson/subsec-t5-french-30k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-subsec_t5_french_30k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-subsec_t5_french_30k_pipeline_en.md new file mode 100644 index 00000000000000..753e2e6377fd1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-subsec_t5_french_30k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English subsec_t5_french_30k_pipeline pipeline T5Transformer from homersimpson +author: John Snow Labs +name: subsec_t5_french_30k_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`subsec_t5_french_30k_pipeline` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/subsec_t5_french_30k_pipeline_en_5.4.2_3.0_1724173193502.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/subsec_t5_french_30k_pipeline_en_5.4.2_3.0_1724173193502.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("subsec_t5_french_30k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("subsec_t5_french_30k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|subsec_t5_french_30k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|511.6 MB| + +## References + +https://huggingface.co/homersimpson/subsec-t5-french-30k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-sum_model_8r1e_3_20epoch_en.md b/docs/_posts/ahmedlone127/2024-08-20-sum_model_8r1e_3_20epoch_en.md new file mode 100644 index 00000000000000..d8a6586afe2644 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-sum_model_8r1e_3_20epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sum_model_8r1e_3_20epoch T5Transformer from weny22 +author: John Snow Labs +name: sum_model_8r1e_3_20epoch +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_8r1e_3_20epoch` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_8r1e_3_20epoch_en_5.4.2_3.0_1724175572211.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_8r1e_3_20epoch_en_5.4.2_3.0_1724175572211.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sum_model_8r1e_3_20epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sum_model_8r1e_3_20epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_8r1e_3_20epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|419.7 MB| + +## References + +https://huggingface.co/weny22/sum_model_8r1e_3_20epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-sum_model_8r1e_3_20epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-sum_model_8r1e_3_20epoch_pipeline_en.md new file mode 100644 index 00000000000000..d95c5a2d8d8f3a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-sum_model_8r1e_3_20epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sum_model_8r1e_3_20epoch_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: sum_model_8r1e_3_20epoch_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_8r1e_3_20epoch_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_8r1e_3_20epoch_pipeline_en_5.4.2_3.0_1724175592463.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_8r1e_3_20epoch_pipeline_en_5.4.2_3.0_1724175592463.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sum_model_8r1e_3_20epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sum_model_8r1e_3_20epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_8r1e_3_20epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|419.7 MB| + +## References + +https://huggingface.co/weny22/sum_model_8r1e_3_20epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-sum_model_lr1e_3_20epoch_en.md b/docs/_posts/ahmedlone127/2024-08-20-sum_model_lr1e_3_20epoch_en.md new file mode 100644 index 00000000000000..b3e85e4741d602 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-sum_model_lr1e_3_20epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sum_model_lr1e_3_20epoch T5Transformer from weny22 +author: John Snow Labs +name: sum_model_lr1e_3_20epoch +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_lr1e_3_20epoch` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_lr1e_3_20epoch_en_5.4.2_3.0_1724195761562.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_lr1e_3_20epoch_en_5.4.2_3.0_1724195761562.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sum_model_lr1e_3_20epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sum_model_lr1e_3_20epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_lr1e_3_20epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|420.4 MB| + +## References + +https://huggingface.co/weny22/sum_model_lr1e_3_20epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-sum_model_lr1e_3_20epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-sum_model_lr1e_3_20epoch_pipeline_en.md new file mode 100644 index 00000000000000..8e6c7e8db61583 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-sum_model_lr1e_3_20epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sum_model_lr1e_3_20epoch_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: sum_model_lr1e_3_20epoch_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_lr1e_3_20epoch_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_lr1e_3_20epoch_pipeline_en_5.4.2_3.0_1724195781896.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_lr1e_3_20epoch_pipeline_en_5.4.2_3.0_1724195781896.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sum_model_lr1e_3_20epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sum_model_lr1e_3_20epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_lr1e_3_20epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|420.4 MB| + +## References + +https://huggingface.co/weny22/sum_model_lr1e_3_20epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_mesh_unfaceted_en.md b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_mesh_unfaceted_en.md new file mode 100644 index 00000000000000..04193f0f8ae697 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_mesh_unfaceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_mesh_unfaceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_mesh_unfaceted +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_mesh_unfaceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_mesh_unfaceted_en_5.4.2_3.0_1724175103822.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_mesh_unfaceted_en_5.4.2_3.0_1724175103822.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_mesh_unfaceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_mesh_unfaceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_mesh_unfaceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_mesh_unfaceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline_en.md new file mode 100644 index 00000000000000..3c96e2fc0cce87 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline_en_5.4.2_3.0_1724175151937.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline_en_5.4.2_3.0_1724175151937.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_mesh_unfaceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_mesh_unfaceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_most_frequent_faceted_en.md b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_most_frequent_faceted_en.md new file mode 100644 index 00000000000000..2a8dd95a2c1b5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_most_frequent_faceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_most_frequent_faceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_most_frequent_faceted +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_most_frequent_faceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_most_frequent_faceted_en_5.4.2_3.0_1724163584618.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_most_frequent_faceted_en_5.4.2_3.0_1724163584618.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_most_frequent_faceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_local_base_most_frequent_faceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_most_frequent_faceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_most_frequent_faceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline_en.md new file mode 100644 index 00000000000000..c6ed76b64ea17c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline_en_5.4.2_3.0_1724163637233.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline_en_5.4.2_3.0_1724163637233.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_local_base_most_frequent_faceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-local-base_most_frequent_faceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_tglobal_base_most_frequent_faceted_en.md b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_tglobal_base_most_frequent_faceted_en.md new file mode 100644 index 00000000000000..0b2c57d553ef03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_tglobal_base_most_frequent_faceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_most_frequent_faceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_most_frequent_faceted +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_most_frequent_faceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_most_frequent_faceted_en_5.4.2_3.0_1724154213225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_most_frequent_faceted_en_5.4.2_3.0_1724154213225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_most_frequent_faceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_most_frequent_faceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_most_frequent_faceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_most_frequent_faceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline_en.md new file mode 100644 index 00000000000000..2f6079b5147c85 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline_en_5.4.2_3.0_1724154263014.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline_en_5.4.2_3.0_1724154263014.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_most_frequent_faceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_most_frequent_faceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-summe_en.md b/docs/_posts/ahmedlone127/2024-08-20-summe_en.md new file mode 100644 index 00000000000000..d5ed2e15017424 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-summe_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summe T5Transformer from golabji +author: John Snow Labs +name: summe +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summe` is a English model originally trained by golabji. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summe_en_5.4.2_3.0_1724172731336.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summe_en_5.4.2_3.0_1724172731336.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summe","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summe", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summe| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.9 MB| + +## References + +https://huggingface.co/golabji/summe \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-summe_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-summe_pipeline_en.md new file mode 100644 index 00000000000000..da55eb2e1f5dfd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-summe_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summe_pipeline pipeline T5Transformer from golabji +author: John Snow Labs +name: summe_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summe_pipeline` is a English model originally trained by golabji. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summe_pipeline_en_5.4.2_3.0_1724172751188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summe_pipeline_en_5.4.2_3.0_1724172751188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summe_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summe_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summe_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.9 MB| + +## References + +https://huggingface.co/golabji/summe + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_1_1_small_dutch_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_1_1_small_dutch_en.md new file mode 100644 index 00000000000000..84e372cb714f77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_1_1_small_dutch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_1_1_small_dutch T5Transformer from yhavinga +author: John Snow Labs +name: t5_1_1_small_dutch +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1_1_small_dutch` is a English model originally trained by yhavinga. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1_1_small_dutch_en_5.4.2_3.0_1724185461000.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1_1_small_dutch_en_5.4.2_3.0_1724185461000.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_1_1_small_dutch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_1_1_small_dutch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1_1_small_dutch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|238.8 MB| + +## References + +https://huggingface.co/yhavinga/t5_1_1-small-dutch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_1_1_small_dutch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_1_1_small_dutch_pipeline_en.md new file mode 100644 index 00000000000000..e884ce5b20dbec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_1_1_small_dutch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_1_1_small_dutch_pipeline pipeline T5Transformer from yhavinga +author: John Snow Labs +name: t5_1_1_small_dutch_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1_1_small_dutch_pipeline` is a English model originally trained by yhavinga. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1_1_small_dutch_pipeline_en_5.4.2_3.0_1724185506123.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1_1_small_dutch_pipeline_en_5.4.2_3.0_1724185506123.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_1_1_small_dutch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_1_1_small_dutch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1_1_small_dutch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|238.8 MB| + +## References + +https://huggingface.co/yhavinga/t5_1_1-small-dutch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2013_9_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2013_9_en.md new file mode 100644 index 00000000000000..5ea779892937fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2013_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_9 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_9_en_5.4.2_3.0_1724192619426.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_9_en_5.4.2_3.0_1724192619426.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2013_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2013_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2013_9_pipeline_en.md new file mode 100644 index 00000000000000..7aaef38f29cf5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2013_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2013_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2013_9_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2013_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_9_pipeline_en_5.4.2_3.0_1724192636428.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2013_9_pipeline_en_5.4.2_3.0_1724192636428.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2013_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2013_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2013_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2013-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_10_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_10_en.md new file mode 100644 index 00000000000000..33f4ecef3e1692 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_10 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_10_en_5.4.2_3.0_1724183814951.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_10_en_5.4.2_3.0_1724183814951.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_10_pipeline_en.md new file mode 100644 index 00000000000000..5d5b94bc8fb822 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_10_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_10_pipeline_en_5.4.2_3.0_1724183832909.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_10_pipeline_en_5.4.2_3.0_1724183832909.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2019_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2019_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_4_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_4_en.md new file mode 100644 index 00000000000000..8e45852a8e3925 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_4_en_5.4.2_3.0_1724172896170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_4_en_5.4.2_3.0_1724172896170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_4_pipeline_en.md new file mode 100644 index 00000000000000..96320f44bf7c88 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_4_pipeline_en_5.4.2_3.0_1724172913941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_4_pipeline_en_5.4.2_3.0_1724172913941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2019_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2019_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_8_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_8_en.md new file mode 100644 index 00000000000000..27f43bd0665083 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_8 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_8_en_5.4.2_3.0_1724183738061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_8_en_5.4.2_3.0_1724183738061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_8_pipeline_en.md new file mode 100644 index 00000000000000..2c11b925846c2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2019_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_8_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_8_pipeline_en_5.4.2_3.0_1724183755110.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_8_pipeline_en_5.4.2_3.0_1724183755110.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2019_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2019_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2020_9_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2020_9_en.md new file mode 100644 index 00000000000000..442dacc8fe29fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2020_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_9 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_9_en_5.4.2_3.0_1724180854967.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_9_en_5.4.2_3.0_1724180854967.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2020_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2020_9_pipeline_en.md new file mode 100644 index 00000000000000..53b01d9df0c2d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2020_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_9_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_9_pipeline_en_5.4.2_3.0_1724180871863.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_9_pipeline_en_5.4.2_3.0_1724180871863.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2020_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2020_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2021_4_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2021_4_en.md new file mode 100644 index 00000000000000..1b7457597079e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2021_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_4_en_5.4.2_3.0_1724189656138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_4_en_5.4.2_3.0_1724189656138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2021_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2021_4_pipeline_en.md new file mode 100644 index 00000000000000..83790ea5afbe04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_lm_wmt_2021_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_4_pipeline_en_5.4.2_3.0_1724189673041.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_4_pipeline_en_5.4.2_3.0_1724189673041.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2021_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2021_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2018_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2018_en.md new file mode 100644 index 00000000000000..59ac9274072680 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2018_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2018 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2018 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2018` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_en_5.4.2_3.0_1724163865914.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_en_5.4.2_3.0_1724163865914.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2018","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2018", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2018| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|321.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2018 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2018_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2018_pipeline_en.md new file mode 100644 index 00000000000000..c329828b4bf14a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2018_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2018_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2018_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2018_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_pipeline_en_5.4.2_3.0_1724163889346.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2018_pipeline_en_5.4.2_3.0_1724163889346.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2018_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2018_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2018_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|321.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2018 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2019_4_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2019_4_en.md new file mode 100644 index 00000000000000..a1d4f381221f59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2019_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_4_en_5.4.2_3.0_1724168549795.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_4_en_5.4.2_3.0_1724168549795.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|299.6 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2019_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2019_4_pipeline_en.md new file mode 100644 index 00000000000000..ae1eede4c4a51b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_60m_poli_aff_2019_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_4_pipeline_en_5.4.2_3.0_1724168578738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_4_pipeline_en_5.4.2_3.0_1724168578738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2019_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2019_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|299.6 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_8m_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_8m_en.md new file mode 100644 index 00000000000000..9c0e6721e998f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_8m_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_8m T5Transformer from versae +author: John Snow Labs +name: t5_8m +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_8m` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_8m_en_5.4.2_3.0_1724164668959.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_8m_en_5.4.2_3.0_1724164668959.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_8m","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_8m", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_8m| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/versae/t5-8m \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_8m_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_8m_pipeline_en.md new file mode 100644 index 00000000000000..2e3434b2d58c6b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_8m_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_8m_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_8m_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_8m_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_8m_pipeline_en_5.4.2_3.0_1724164715332.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_8m_pipeline_en_5.4.2_3.0_1724164715332.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_8m_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_8m_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_8m_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/versae/t5-8m + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_en.md new file mode 100644 index 00000000000000..9da4cb1f1957b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_en_5.4.2_3.0_1724186373393.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_en_5.4.2_3.0_1724186373393.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|954.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-256-finetuned-squad-infilling-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..c8b25024fb41b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline_en_5.4.2_3.0_1724186437897.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline_en_5.4.2_3.0_1724186437897.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_256_finetuned_squad_infilling_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|954.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-256-finetuned-squad-infilling-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_on_eredat_kelm_q4_epoch10_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_on_eredat_kelm_q4_epoch10_en.md new file mode 100644 index 00000000000000..267c3882058fdb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_on_eredat_kelm_q4_epoch10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_on_eredat_kelm_q4_epoch10 T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_finetuned_on_eredat_kelm_q4_epoch10 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_on_eredat_kelm_q4_epoch10` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_on_eredat_kelm_q4_epoch10_en_5.4.2_3.0_1724189993680.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_on_eredat_kelm_q4_epoch10_en_5.4.2_3.0_1724189993680.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_on_eredat_kelm_q4_epoch10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_on_eredat_kelm_q4_epoch10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_on_eredat_kelm_q4_epoch10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/OneFly7/T5-base-finetuned-on-eredat-kelm-Q4-epoch10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline_en.md new file mode 100644 index 00000000000000..9143bb59d276ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline pipeline T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline_en_5.4.2_3.0_1724190044046.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline_en_5.4.2_3.0_1724190044046.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_on_eredat_kelm_q4_epoch10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/OneFly7/T5-base-finetuned-on-eredat-kelm-Q4-epoch10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_stocknews_2000_longshort_100_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_stocknews_2000_longshort_100_en.md new file mode 100644 index 00000000000000..c3ec2f1c648b90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_stocknews_2000_longshort_100_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_stocknews_2000_longshort_100 T5Transformer from sujayC66 +author: John Snow Labs +name: t5_base_finetuned_stocknews_2000_longshort_100 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_stocknews_2000_longshort_100` is a English model originally trained by sujayC66. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_stocknews_2000_longshort_100_en_5.4.2_3.0_1724181897731.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_stocknews_2000_longshort_100_en_5.4.2_3.0_1724181897731.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_stocknews_2000_longshort_100","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_stocknews_2000_longshort_100", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_stocknews_2000_longshort_100| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.7 MB| + +## References + +https://huggingface.co/sujayC66/t5-base-finetuned-stocknews_2000_longshort_100 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_stocknews_2000_longshort_100_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_stocknews_2000_longshort_100_pipeline_en.md new file mode 100644 index 00000000000000..d6714e4fef462f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_stocknews_2000_longshort_100_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_stocknews_2000_longshort_100_pipeline pipeline T5Transformer from sujayC66 +author: John Snow Labs +name: t5_base_finetuned_stocknews_2000_longshort_100_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_stocknews_2000_longshort_100_pipeline` is a English model originally trained by sujayC66. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_stocknews_2000_longshort_100_pipeline_en_5.4.2_3.0_1724181950312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_stocknews_2000_longshort_100_pipeline_en_5.4.2_3.0_1724181950312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_stocknews_2000_longshort_100_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_stocknews_2000_longshort_100_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_stocknews_2000_longshort_100_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.7 MB| + +## References + +https://huggingface.co/sujayC66/t5-base-finetuned-stocknews_2000_longshort_100 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_weaksup_1000_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_weaksup_1000_en.md new file mode 100644 index 00000000000000..2c54ebdafbd754 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_weaksup_1000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_weaksup_1000 T5Transformer from cammy +author: John Snow Labs +name: t5_base_finetuned_weaksup_1000 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_weaksup_1000` is a English model originally trained by cammy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_weaksup_1000_en_5.4.2_3.0_1724196247510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_weaksup_1000_en_5.4.2_3.0_1724196247510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_weaksup_1000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_weaksup_1000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_weaksup_1000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|979.5 MB| + +## References + +https://huggingface.co/cammy/t5-base-finetuned-weaksup-1000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_weaksup_1000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_weaksup_1000_pipeline_en.md new file mode 100644 index 00000000000000..cf2be5c5b2eef8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_finetuned_weaksup_1000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_weaksup_1000_pipeline pipeline T5Transformer from cammy +author: John Snow Labs +name: t5_base_finetuned_weaksup_1000_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_weaksup_1000_pipeline` is a English model originally trained by cammy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_weaksup_1000_pipeline_en_5.4.2_3.0_1724196297527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_weaksup_1000_pipeline_en_5.4.2_3.0_1724196297527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_weaksup_1000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_weaksup_1000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_weaksup_1000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|979.5 MB| + +## References + +https://huggingface.co/cammy/t5-base-finetuned-weaksup-1000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_model_v2_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_model_v2_en.md new file mode 100644 index 00000000000000..61b43ebc223771 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_model_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_model_v2 T5Transformer from vy2388 +author: John Snow Labs +name: t5_base_model_v2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_model_v2` is a English model originally trained by vy2388. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_model_v2_en_5.4.2_3.0_1724151302110.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_model_v2_en_5.4.2_3.0_1724151302110.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_model_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_model_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_model_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1000.0 MB| + +## References + +https://huggingface.co/vy2388/T5_base_model_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_model_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_model_v2_pipeline_en.md new file mode 100644 index 00000000000000..e9284ba5bf067e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_model_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_model_v2_pipeline pipeline T5Transformer from vy2388 +author: John Snow Labs +name: t5_base_model_v2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_model_v2_pipeline` is a English model originally trained by vy2388. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_model_v2_pipeline_en_5.4.2_3.0_1724151349940.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_model_v2_pipeline_en_5.4.2_3.0_1724151349940.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_model_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_model_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_model_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1000.0 MB| + +## References + +https://huggingface.co/vy2388/T5_base_model_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_rlhf_hint_bm25_beauty_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_rlhf_hint_bm25_beauty_en.md new file mode 100644 index 00000000000000..2ae5c218089463 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_rlhf_hint_bm25_beauty_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_hint_bm25_beauty T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_hint_bm25_beauty +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_hint_bm25_beauty` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_hint_bm25_beauty_en_5.4.2_3.0_1724198149297.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_hint_bm25_beauty_en_5.4.2_3.0_1724198149297.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_hint_bm25_beauty","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_hint_bm25_beauty", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_hint_bm25_beauty| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.9 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-hint-bm25-beauty \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_rlhf_hint_bm25_beauty_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_rlhf_hint_bm25_beauty_pipeline_en.md new file mode 100644 index 00000000000000..f462542e7911cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_rlhf_hint_bm25_beauty_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_hint_bm25_beauty_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_hint_bm25_beauty_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_hint_bm25_beauty_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_hint_bm25_beauty_pipeline_en_5.4.2_3.0_1724198209064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_hint_bm25_beauty_pipeline_en_5.4.2_3.0_1724198209064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_hint_bm25_beauty_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_hint_bm25_beauty_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_hint_bm25_beauty_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.9 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-hint-bm25-beauty + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_samsumgen_xsum_conv_seed33_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_samsumgen_xsum_conv_seed33_en.md new file mode 100644 index 00000000000000..4f4869307c152c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_samsumgen_xsum_conv_seed33_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_seed33 T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_seed33 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_seed33` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed33_en_5.4.2_3.0_1724173553959.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed33_en_5.4.2_3.0_1724173553959.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_seed33","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_seed33", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_seed33| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-seed33 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_samsumgen_xsum_conv_seed33_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_samsumgen_xsum_conv_seed33_pipeline_en.md new file mode 100644 index 00000000000000..822d5336d2d551 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_samsumgen_xsum_conv_seed33_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_seed33_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_seed33_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_seed33_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed33_pipeline_en_5.4.2_3.0_1724173608499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed33_pipeline_en_5.4.2_3.0_1724173608499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_samsumgen_xsum_conv_seed33_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_samsumgen_xsum_conv_seed33_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_seed33_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-seed33 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_10front_1body_10rear_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_10front_1body_10rear_en.md new file mode 100644 index 00000000000000..245b40ad4887a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_10front_1body_10rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_10front_1body_10rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_10front_1body_10rear +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_10front_1body_10rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_10front_1body_10rear_en_5.4.2_3.0_1724190105356.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_10front_1body_10rear_en_5.4.2_3.0_1724190105356.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_10front_1body_10rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_10front_1body_10rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_10front_1body_10rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-10front-1body-10rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_10front_1body_10rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_10front_1body_10rear_pipeline_en.md new file mode 100644 index 00000000000000..97f71f8d359f9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_10front_1body_10rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_10front_1body_10rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_10front_1body_10rear_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_10front_1body_10rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_10front_1body_10rear_pipeline_en_5.4.2_3.0_1724190155538.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_10front_1body_10rear_pipeline_en_5.4.2_3.0_1724190155538.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_10front_1body_10rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_10front_1body_10rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_10front_1body_10rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-10front-1body-10rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_1front_1body_0rear_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_1front_1body_0rear_en.md new file mode 100644 index 00000000000000..0ec8f7f2fd443d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_1front_1body_0rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_1front_1body_0rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_1front_1body_0rear +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_1front_1body_0rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_1front_1body_0rear_en_5.4.2_3.0_1724176488323.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_1front_1body_0rear_en_5.4.2_3.0_1724176488323.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_1front_1body_0rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_1front_1body_0rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_1front_1body_0rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-1front-1body-0rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_1front_1body_0rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_1front_1body_0rear_pipeline_en.md new file mode 100644 index 00000000000000..ea714a23aed8db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tedxjp_1front_1body_0rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_1front_1body_0rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_1front_1body_0rear_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_1front_1body_0rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_1front_1body_0rear_pipeline_en_5.4.2_3.0_1724176537472.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_1front_1body_0rear_pipeline_en_5.4.2_3.0_1724176537472.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_1front_1body_0rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_1front_1body_0rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_1front_1body_0rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-1front-1body-0rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_en.md new file mode 100644 index 00000000000000..955641cce64607 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17 T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_en_5.4.2_3.0_1724194996401.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_en_5.4.2_3.0_1724194996401.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsummgen-xsum-conv-tweetsumm-seed17 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline_en.md new file mode 100644 index 00000000000000..e4a42ed8489e68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline_en_5.4.2_3.0_1724195046020.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline_en_5.4.2_3.0_1724195046020.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsummgen_xsum_conv_tweetsumm_seed17_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsummgen-xsum-conv-tweetsumm-seed17 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_dialog_jp_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_dialog_jp_en.md new file mode 100644 index 00000000000000..5ec0cc49f478d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_dialog_jp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_dialog_jp T5Transformer from Huaibo +author: John Snow Labs +name: t5_dialog_jp +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialog_jp` is a English model originally trained by Huaibo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialog_jp_en_5.4.2_3.0_1724173887126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialog_jp_en_5.4.2_3.0_1724173887126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_dialog_jp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_dialog_jp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialog_jp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Huaibo/t5_dialog_jp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_dialog_jp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_dialog_jp_pipeline_en.md new file mode 100644 index 00000000000000..23f1abda0e1c4f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_dialog_jp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_dialog_jp_pipeline pipeline T5Transformer from Huaibo +author: John Snow Labs +name: t5_dialog_jp_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialog_jp_pipeline` is a English model originally trained by Huaibo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialog_jp_pipeline_en_5.4.2_3.0_1724173936291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialog_jp_pipeline_en_5.4.2_3.0_1724173936291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_dialog_jp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_dialog_jp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialog_jp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Huaibo/t5_dialog_jp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_f_experiment_4_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_f_experiment_4_en.md new file mode 100644 index 00000000000000..1446136415b95c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_f_experiment_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_f_experiment_4 T5Transformer from mllm-dev +author: John Snow Labs +name: t5_f_experiment_4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_f_experiment_4` is a English model originally trained by mllm-dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_f_experiment_4_en_5.4.2_3.0_1724156594914.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_f_experiment_4_en_5.4.2_3.0_1724156594914.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_f_experiment_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_f_experiment_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_f_experiment_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|294.0 MB| + +## References + +https://huggingface.co/mllm-dev/t5_f_experiment_4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_f_experiment_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_f_experiment_4_pipeline_en.md new file mode 100644 index 00000000000000..8f121617535aca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_f_experiment_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_f_experiment_4_pipeline pipeline T5Transformer from mllm-dev +author: John Snow Labs +name: t5_f_experiment_4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_f_experiment_4_pipeline` is a English model originally trained by mllm-dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_f_experiment_4_pipeline_en_5.4.2_3.0_1724156621920.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_f_experiment_4_pipeline_en_5.4.2_3.0_1724156621920.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_f_experiment_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_f_experiment_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_f_experiment_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|294.0 MB| + +## References + +https://huggingface.co/mllm-dev/t5_f_experiment_4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_jump_adafactor_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_jump_adafactor_en.md new file mode 100644 index 00000000000000..f3fa096db14a50 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_jump_adafactor_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_jump_adafactor T5Transformer from LadyShizu +author: John Snow Labs +name: t5_jump_adafactor +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_jump_adafactor` is a English model originally trained by LadyShizu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_jump_adafactor_en_5.4.2_3.0_1724161208738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_jump_adafactor_en_5.4.2_3.0_1724161208738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_jump_adafactor","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_jump_adafactor", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_jump_adafactor| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LadyShizu/T5_jump_adafactor \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_jump_adafactor_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_jump_adafactor_pipeline_en.md new file mode 100644 index 00000000000000..cff87b5c2d74c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_jump_adafactor_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_jump_adafactor_pipeline pipeline T5Transformer from LadyShizu +author: John Snow Labs +name: t5_jump_adafactor_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_jump_adafactor_pipeline` is a English model originally trained by LadyShizu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_jump_adafactor_pipeline_en_5.4.2_3.0_1724161256166.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_jump_adafactor_pipeline_en_5.4.2_3.0_1724161256166.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_jump_adafactor_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_jump_adafactor_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_jump_adafactor_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LadyShizu/T5_jump_adafactor + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_large_radiology_cardiothoracic_imagingcancer_0_8_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_large_radiology_cardiothoracic_imagingcancer_0_8_en.md new file mode 100644 index 00000000000000..a3625483a8657f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_large_radiology_cardiothoracic_imagingcancer_0_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_radiology_cardiothoracic_imagingcancer_0_8 T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_radiology_cardiothoracic_imagingcancer_0_8 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_radiology_cardiothoracic_imagingcancer_0_8` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_radiology_cardiothoracic_imagingcancer_0_8_en_5.4.2_3.0_1724163607318.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_radiology_cardiothoracic_imagingcancer_0_8_en_5.4.2_3.0_1724163607318.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_radiology_cardiothoracic_imagingcancer_0_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_radiology_cardiothoracic_imagingcancer_0_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_radiology_cardiothoracic_imagingcancer_0_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_radiology-cardiothoracic-imagingcancer-0.8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline_en.md new file mode 100644 index 00000000000000..0b42d509436fd5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline pipeline T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline_en_5.4.2_3.0_1724163768196.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline_en_5.4.2_3.0_1724163768196.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_radiology_cardiothoracic_imagingcancer_0_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_radiology-cardiothoracic-imagingcancer-0.8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_large_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_large_xsum_en.md new file mode 100644 index 00000000000000..51fb81de403283 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_large_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_xsum T5Transformer from kssteven +author: John Snow Labs +name: t5_large_xsum +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_xsum` is a English model originally trained by kssteven. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_xsum_en_5.4.2_3.0_1724195621445.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_xsum_en_5.4.2_3.0_1724195621445.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kssteven/T5-large-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_large_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_large_xsum_pipeline_en.md new file mode 100644 index 00000000000000..7b4b5d984e15eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_large_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_xsum_pipeline pipeline T5Transformer from kssteven +author: John Snow Labs +name: t5_large_xsum_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_xsum_pipeline` is a English model originally trained by kssteven. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_xsum_pipeline_en_5.4.2_3.0_1724195763702.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_xsum_pipeline_en_5.4.2_3.0_1724195763702.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/kssteven/T5-large-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_model_1_d_2_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_model_1_d_2_en.md new file mode 100644 index 00000000000000..4947c9db3db77d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_model_1_d_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_1_d_2 T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_d_2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_d_2` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_d_2_en_5.4.2_3.0_1724185556819.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_d_2_en_5.4.2_3.0_1724185556819.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_1_d_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_1_d_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_d_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|958.6 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-d-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_model_1_d_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_model_1_d_2_pipeline_en.md new file mode 100644 index 00000000000000..51ed7fce50c3d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_model_1_d_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_1_d_2_pipeline pipeline T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_d_2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_d_2_pipeline` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_d_2_pipeline_en_5.4.2_3.0_1724185607909.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_d_2_pipeline_en_5.4.2_3.0_1724185607909.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_1_d_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_1_d_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_d_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|958.6 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-d-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_multinews_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_multinews_en.md new file mode 100644 index 00000000000000..552a8a7e60b4b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_multinews_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_multinews T5Transformer from jvelja +author: John Snow Labs +name: t5_multinews +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_multinews` is a English model originally trained by jvelja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_multinews_en_5.4.2_3.0_1724176590395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_multinews_en_5.4.2_3.0_1724176590395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_multinews","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_multinews", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_multinews| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jvelja/t5-multinews \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_multinews_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_multinews_pipeline_en.md new file mode 100644 index 00000000000000..f8f67985775760 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_multinews_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_multinews_pipeline pipeline T5Transformer from jvelja +author: John Snow Labs +name: t5_multinews_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_multinews_pipeline` is a English model originally trained by jvelja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_multinews_pipeline_en_5.4.2_3.0_1724176639271.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_multinews_pipeline_en_5.4.2_3.0_1724176639271.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_multinews_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_multinews_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_multinews_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jvelja/t5-multinews + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_nepal_bhasa_mcq_vam_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_nepal_bhasa_mcq_vam_en.md new file mode 100644 index 00000000000000..35eca136b5d191 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_nepal_bhasa_mcq_vam_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_nepal_bhasa_mcq_vam T5Transformer from vishal2014 +author: John Snow Labs +name: t5_nepal_bhasa_mcq_vam +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_nepal_bhasa_mcq_vam` is a English model originally trained by vishal2014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_nepal_bhasa_mcq_vam_en_5.4.2_3.0_1724178384199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_nepal_bhasa_mcq_vam_en_5.4.2_3.0_1724178384199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_nepal_bhasa_mcq_vam","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_nepal_bhasa_mcq_vam", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_nepal_bhasa_mcq_vam| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vishal2014/t5_new_mcq_vam \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_nepal_bhasa_mcq_vam_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_nepal_bhasa_mcq_vam_pipeline_en.md new file mode 100644 index 00000000000000..60e78eb1f4d704 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_nepal_bhasa_mcq_vam_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_nepal_bhasa_mcq_vam_pipeline pipeline T5Transformer from vishal2014 +author: John Snow Labs +name: t5_nepal_bhasa_mcq_vam_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_nepal_bhasa_mcq_vam_pipeline` is a English model originally trained by vishal2014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_nepal_bhasa_mcq_vam_pipeline_en_5.4.2_3.0_1724178433840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_nepal_bhasa_mcq_vam_pipeline_en_5.4.2_3.0_1724178433840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_nepal_bhasa_mcq_vam_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_nepal_bhasa_mcq_vam_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_nepal_bhasa_mcq_vam_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vishal2014/t5_new_mcq_vam + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_paraphrase_pytorch_lightning_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_paraphrase_pytorch_lightning_en.md new file mode 100644 index 00000000000000..7f4ef5328c70e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_paraphrase_pytorch_lightning_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_paraphrase_pytorch_lightning T5Transformer from jaimin +author: John Snow Labs +name: t5_paraphrase_pytorch_lightning +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_paraphrase_pytorch_lightning` is a English model originally trained by jaimin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_paraphrase_pytorch_lightning_en_5.4.2_3.0_1724188776233.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_paraphrase_pytorch_lightning_en_5.4.2_3.0_1724188776233.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_paraphrase_pytorch_lightning","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_paraphrase_pytorch_lightning", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_paraphrase_pytorch_lightning| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|987.1 MB| + +## References + +https://huggingface.co/jaimin/T5-ParaPhrase-Pytorch-Lightning \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_paraphrase_pytorch_lightning_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_paraphrase_pytorch_lightning_pipeline_en.md new file mode 100644 index 00000000000000..d3710abfaef37e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_paraphrase_pytorch_lightning_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_paraphrase_pytorch_lightning_pipeline pipeline T5Transformer from jaimin +author: John Snow Labs +name: t5_paraphrase_pytorch_lightning_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_paraphrase_pytorch_lightning_pipeline` is a English model originally trained by jaimin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_paraphrase_pytorch_lightning_pipeline_en_5.4.2_3.0_1724188828281.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_paraphrase_pytorch_lightning_pipeline_en_5.4.2_3.0_1724188828281.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_paraphrase_pytorch_lightning_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_paraphrase_pytorch_lightning_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_paraphrase_pytorch_lightning_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|987.1 MB| + +## References + +https://huggingface.co/jaimin/T5-ParaPhrase-Pytorch-Lightning + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_recommendation_sports_equipment_english_wyoung1_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_recommendation_sports_equipment_english_wyoung1_en.md new file mode 100644 index 00000000000000..96472c1e6ff8c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_recommendation_sports_equipment_english_wyoung1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_wyoung1 T5Transformer from Wyoung1 +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_wyoung1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_wyoung1` is a English model originally trained by Wyoung1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_wyoung1_en_5.4.2_3.0_1724177587068.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_wyoung1_en_5.4.2_3.0_1724177587068.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_wyoung1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_wyoung1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_wyoung1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/Wyoung1/t5_recommendation_sports_equipment_english \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_recommendation_sports_equipment_english_wyoung1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_recommendation_sports_equipment_english_wyoung1_pipeline_en.md new file mode 100644 index 00000000000000..55d7d8f8f2fd86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_recommendation_sports_equipment_english_wyoung1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_wyoung1_pipeline pipeline T5Transformer from Wyoung1 +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_wyoung1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_wyoung1_pipeline` is a English model originally trained by Wyoung1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_wyoung1_pipeline_en_5.4.2_3.0_1724177791638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_wyoung1_pipeline_en_5.4.2_3.0_1724177791638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_recommendation_sports_equipment_english_wyoung1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_recommendation_sports_equipment_english_wyoung1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_wyoung1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/Wyoung1/t5_recommendation_sports_equipment_english + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_reformulation_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_reformulation_en.md new file mode 100644 index 00000000000000..979e4d33497428 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_reformulation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_reformulation T5Transformer from irp1999 +author: John Snow Labs +name: t5_reformulation +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_reformulation` is a English model originally trained by irp1999. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_reformulation_en_5.4.2_3.0_1724178839526.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_reformulation_en_5.4.2_3.0_1724178839526.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_reformulation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_reformulation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_reformulation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/irp1999/t5-reformulation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_reformulation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_reformulation_pipeline_en.md new file mode 100644 index 00000000000000..0e1e2a37a80f1c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_reformulation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_reformulation_pipeline pipeline T5Transformer from irp1999 +author: John Snow Labs +name: t5_reformulation_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_reformulation_pipeline` is a English model originally trained by irp1999. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_reformulation_pipeline_en_5.4.2_3.0_1724178887185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_reformulation_pipeline_en_5.4.2_3.0_1724178887185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_reformulation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_reformulation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_reformulation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/irp1999/t5-reformulation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_samsung_5e_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_samsung_5e_en.md new file mode 100644 index 00000000000000..12930c5d2276ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_samsung_5e_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_samsung_5e T5Transformer from Yanjie24 +author: John Snow Labs +name: t5_samsung_5e +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_samsung_5e` is a English model originally trained by Yanjie24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_samsung_5e_en_5.4.2_3.0_1724180471456.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_samsung_5e_en_5.4.2_3.0_1724180471456.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_samsung_5e","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_samsung_5e", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_samsung_5e| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.7 MB| + +## References + +https://huggingface.co/Yanjie24/t5-samsung-5e \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_samsung_5e_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_samsung_5e_pipeline_en.md new file mode 100644 index 00000000000000..6eb5c93182726b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_samsung_5e_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_samsung_5e_pipeline pipeline T5Transformer from Yanjie24 +author: John Snow Labs +name: t5_samsung_5e_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_samsung_5e_pipeline` is a English model originally trained by Yanjie24. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_samsung_5e_pipeline_en_5.4.2_3.0_1724180489460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_samsung_5e_pipeline_en_5.4.2_3.0_1724180489460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_samsung_5e_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_samsung_5e_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_samsung_5e_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.7 MB| + +## References + +https://huggingface.co/Yanjie24/t5-samsung-5e + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_booksum_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_booksum_en.md new file mode 100644 index 00000000000000..08c81b2eb7d073 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_booksum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_booksum T5Transformer from romainlhardy +author: John Snow Labs +name: t5_small_booksum +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_booksum` is a English model originally trained by romainlhardy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_booksum_en_5.4.2_3.0_1724166522259.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_booksum_en_5.4.2_3.0_1724166522259.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_booksum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_booksum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_booksum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.9 MB| + +## References + +https://huggingface.co/romainlhardy/t5-small-booksum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_booksum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_booksum_pipeline_en.md new file mode 100644 index 00000000000000..37f305a6348d26 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_booksum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_booksum_pipeline pipeline T5Transformer from romainlhardy +author: John Snow Labs +name: t5_small_booksum_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_booksum_pipeline` is a English model originally trained by romainlhardy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_booksum_pipeline_en_5.4.2_3.0_1724166542771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_booksum_pipeline_en_5.4.2_3.0_1724166542771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_booksum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_booksum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_booksum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.9 MB| + +## References + +https://huggingface.co/romainlhardy/t5-small-booksum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_eurlexsum_8epochs_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_eurlexsum_8epochs_en.md new file mode 100644 index 00000000000000..de4d5e05ba7ce7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_eurlexsum_8epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_eurlexsum_8epochs T5Transformer from Pierre-Arthur +author: John Snow Labs +name: t5_small_eurlexsum_8epochs +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_eurlexsum_8epochs` is a English model originally trained by Pierre-Arthur. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_eurlexsum_8epochs_en_5.4.2_3.0_1724186015511.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_eurlexsum_8epochs_en_5.4.2_3.0_1724186015511.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_eurlexsum_8epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_eurlexsum_8epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_eurlexsum_8epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.9 MB| + +## References + +https://huggingface.co/Pierre-Arthur/T5_small_eurlexsum_8Epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_eurlexsum_8epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_eurlexsum_8epochs_pipeline_en.md new file mode 100644 index 00000000000000..ae49e4d11a3a78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_eurlexsum_8epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_eurlexsum_8epochs_pipeline pipeline T5Transformer from Pierre-Arthur +author: John Snow Labs +name: t5_small_eurlexsum_8epochs_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_eurlexsum_8epochs_pipeline` is a English model originally trained by Pierre-Arthur. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_eurlexsum_8epochs_pipeline_en_5.4.2_3.0_1724186037185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_eurlexsum_8epochs_pipeline_en_5.4.2_3.0_1724186037185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_eurlexsum_8epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_eurlexsum_8epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_eurlexsum_8epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.9 MB| + +## References + +https://huggingface.co/Pierre-Arthur/T5_small_eurlexsum_8Epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_cnn_3_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_cnn_3_en.md new file mode 100644 index 00000000000000..e20f1d19b72549 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_cnn_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_cnn_3 T5Transformer from nizamudma +author: John Snow Labs +name: t5_small_finetuned_cnn_3 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_cnn_3` is a English model originally trained by nizamudma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_3_en_5.4.2_3.0_1724196814520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_3_en_5.4.2_3.0_1724196814520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_cnn_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_cnn_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_cnn_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.4 MB| + +## References + +https://huggingface.co/nizamudma/t5-small-finetuned-cnn-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_cnn_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_cnn_3_pipeline_en.md new file mode 100644 index 00000000000000..17023f389b6774 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_cnn_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_cnn_3_pipeline pipeline T5Transformer from nizamudma +author: John Snow Labs +name: t5_small_finetuned_cnn_3_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_cnn_3_pipeline` is a English model originally trained by nizamudma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_3_pipeline_en_5.4.2_3.0_1724196831419.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_cnn_3_pipeline_en_5.4.2_3.0_1724196831419.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_cnn_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_cnn_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_cnn_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.4 MB| + +## References + +https://huggingface.co/nizamudma/t5-small-finetuned-cnn-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_contextcraft_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_contextcraft_en.md new file mode 100644 index 00000000000000..e64ab1075bb1e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_contextcraft_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_contextcraft T5Transformer from Ajas2002 +author: John Snow Labs +name: t5_small_finetuned_contextcraft +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_contextcraft` is a English model originally trained by Ajas2002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_contextcraft_en_5.4.2_3.0_1724176698442.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_contextcraft_en_5.4.2_3.0_1724176698442.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_contextcraft","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_contextcraft", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_contextcraft| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|290.3 MB| + +## References + +https://huggingface.co/Ajas2002/t5-small-finetuned-contextcraft \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_contextcraft_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_contextcraft_pipeline_en.md new file mode 100644 index 00000000000000..b2aed4d4703f37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_contextcraft_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_contextcraft_pipeline pipeline T5Transformer from Ajas2002 +author: John Snow Labs +name: t5_small_finetuned_contextcraft_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_contextcraft_pipeline` is a English model originally trained by Ajas2002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_contextcraft_pipeline_en_5.4.2_3.0_1724176725171.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_contextcraft_pipeline_en_5.4.2_3.0_1724176725171.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_contextcraft_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_contextcraft_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_contextcraft_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|290.3 MB| + +## References + +https://huggingface.co/Ajas2002/t5-small-finetuned-contextcraft + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_en.md new file mode 100644 index 00000000000000..7a90e943cb6a8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_clean T5Transformer from himanshubeniwal +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_clean +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_clean` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_en_5.4.2_3.0_1724162154427.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_en_5.4.2_3.0_1724162154427.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_clean","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_clean", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_clean| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/himanshubeniwal/t5-small-finetuned-en-to-ro-clean \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline_en.md new file mode 100644 index 00000000000000..362d5bc1d6a017 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline pipeline T5Transformer from himanshubeniwal +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline_en_5.4.2_3.0_1724162172726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline_en_5.4.2_3.0_1724162172726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_clean_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.6 MB| + +## References + +https://huggingface.co/himanshubeniwal/t5-small-finetuned-en-to-ro-clean + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_bienthuy_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_bienthuy_en.md new file mode 100644 index 00000000000000..ded0907a9c1925 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_bienthuy_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_manimml_bienthuy T5Transformer from BienThuy +author: John Snow Labs +name: t5_small_finetuned_manimml_bienthuy +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_manimml_bienthuy` is a English model originally trained by BienThuy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_bienthuy_en_5.4.2_3.0_1724189782387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_bienthuy_en_5.4.2_3.0_1724189782387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_manimml_bienthuy","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_manimml_bienthuy", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_manimml_bienthuy| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|313.1 MB| + +## References + +https://huggingface.co/BienThuy/t5-small-finetuned-manimml \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_bienthuy_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_bienthuy_pipeline_en.md new file mode 100644 index 00000000000000..cde92f219667d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_bienthuy_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_manimml_bienthuy_pipeline pipeline T5Transformer from BienThuy +author: John Snow Labs +name: t5_small_finetuned_manimml_bienthuy_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_manimml_bienthuy_pipeline` is a English model originally trained by BienThuy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_bienthuy_pipeline_en_5.4.2_3.0_1724189806182.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_bienthuy_pipeline_en_5.4.2_3.0_1724189806182.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_manimml_bienthuy_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_manimml_bienthuy_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_manimml_bienthuy_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|313.1 MB| + +## References + +https://huggingface.co/BienThuy/t5-small-finetuned-manimml + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_chutuanduc_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_chutuanduc_en.md new file mode 100644 index 00000000000000..5972ba5e587f98 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_chutuanduc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_manimml_chutuanduc T5Transformer from ChuTuanDuc +author: John Snow Labs +name: t5_small_finetuned_manimml_chutuanduc +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_manimml_chutuanduc` is a English model originally trained by ChuTuanDuc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_chutuanduc_en_5.4.2_3.0_1724163622036.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_chutuanduc_en_5.4.2_3.0_1724163622036.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_manimml_chutuanduc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_manimml_chutuanduc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_manimml_chutuanduc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|310.2 MB| + +## References + +https://huggingface.co/ChuTuanDuc/t5-small-finetuned-manimml \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_chutuanduc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_chutuanduc_pipeline_en.md new file mode 100644 index 00000000000000..a248078b6b3895 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_manimml_chutuanduc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_manimml_chutuanduc_pipeline pipeline T5Transformer from ChuTuanDuc +author: John Snow Labs +name: t5_small_finetuned_manimml_chutuanduc_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_manimml_chutuanduc_pipeline` is a English model originally trained by ChuTuanDuc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_chutuanduc_pipeline_en_5.4.2_3.0_1724163646757.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_chutuanduc_pipeline_en_5.4.2_3.0_1724163646757.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_manimml_chutuanduc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_manimml_chutuanduc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_manimml_chutuanduc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|310.2 MB| + +## References + +https://huggingface.co/ChuTuanDuc/t5-small-finetuned-manimml + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_reddit_dataset_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_reddit_dataset_en.md new file mode 100644 index 00000000000000..491b4e27a0403d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_reddit_dataset_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_reddit_dataset T5Transformer from harshm16 +author: John Snow Labs +name: t5_small_finetuned_reddit_dataset +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_reddit_dataset` is a English model originally trained by harshm16. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_reddit_dataset_en_5.4.2_3.0_1724151215203.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_reddit_dataset_en_5.4.2_3.0_1724151215203.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_reddit_dataset","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_reddit_dataset", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_reddit_dataset| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.2 MB| + +## References + +https://huggingface.co/harshm16/t5-small-finetuned-reddit_dataset \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_reddit_dataset_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_reddit_dataset_pipeline_en.md new file mode 100644 index 00000000000000..824a4280201e0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_reddit_dataset_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_reddit_dataset_pipeline pipeline T5Transformer from harshm16 +author: John Snow Labs +name: t5_small_finetuned_reddit_dataset_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_reddit_dataset_pipeline` is a English model originally trained by harshm16. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_reddit_dataset_pipeline_en_5.4.2_3.0_1724151232436.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_reddit_dataset_pipeline_en_5.4.2_3.0_1724151232436.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_reddit_dataset_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_reddit_dataset_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_reddit_dataset_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.2 MB| + +## References + +https://huggingface.co/harshm16/t5-small-finetuned-reddit_dataset + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_en.md new file mode 100644 index 00000000000000..b95783b2611df1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01 T5Transformer from spongebob01 +author: John Snow Labs +name: t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01` is a English model originally trained by spongebob01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_en_5.4.2_3.0_1724185796389.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_en_5.4.2_3.0_1724185796389.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|279.8 MB| + +## References + +https://huggingface.co/spongebob01/t5-small-finetuned-es-to-pt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline_en.md new file mode 100644 index 00000000000000..9b455751266538 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline pipeline T5Transformer from spongebob01 +author: John Snow Labs +name: t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline` is a English model originally trained by spongebob01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline_en_5.4.2_3.0_1724185825502.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline_en_5.4.2_3.0_1724185825502.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_spanish_tonga_tonga_islands_portuguese_spongebob01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|279.8 MB| + +## References + +https://huggingface.co/spongebob01/t5-small-finetuned-es-to-pt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_tq_tonga_tonga_islands_arabic_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_tq_tonga_tonga_islands_arabic_en.md new file mode 100644 index 00000000000000..b1bf3918c88d4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_tq_tonga_tonga_islands_arabic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_tq_tonga_tonga_islands_arabic T5Transformer from YassineBenlaria +author: John Snow Labs +name: t5_small_finetuned_tq_tonga_tonga_islands_arabic +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_tq_tonga_tonga_islands_arabic` is a English model originally trained by YassineBenlaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_tq_tonga_tonga_islands_arabic_en_5.4.2_3.0_1724157293014.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_tq_tonga_tonga_islands_arabic_en_5.4.2_3.0_1724157293014.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_tq_tonga_tonga_islands_arabic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_tq_tonga_tonga_islands_arabic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_tq_tonga_tonga_islands_arabic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|324.6 MB| + +## References + +https://huggingface.co/YassineBenlaria/t5-small-finetuned-tq-to-ar \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline_en.md new file mode 100644 index 00000000000000..70f6ed57217d39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline pipeline T5Transformer from YassineBenlaria +author: John Snow Labs +name: t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline` is a English model originally trained by YassineBenlaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline_en_5.4.2_3.0_1724157310473.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline_en_5.4.2_3.0_1724157310473.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_tq_tonga_tonga_islands_arabic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|324.6 MB| + +## References + +https://huggingface.co/YassineBenlaria/t5-small-finetuned-tq-to-ar + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_vehidefect_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_vehidefect_en.md new file mode 100644 index 00000000000000..edde216122ccf5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_vehidefect_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_vehidefect T5Transformer from ItsMayur +author: John Snow Labs +name: t5_small_finetuned_vehidefect +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_vehidefect` is a English model originally trained by ItsMayur. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_vehidefect_en_5.4.2_3.0_1724163402950.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_vehidefect_en_5.4.2_3.0_1724163402950.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_vehidefect","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_vehidefect", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_vehidefect| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|271.1 MB| + +## References + +https://huggingface.co/ItsMayur/t5-small-finetuned-vehidefect \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_vehidefect_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_vehidefect_pipeline_en.md new file mode 100644 index 00000000000000..8928d2d4b66f56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_vehidefect_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_vehidefect_pipeline pipeline T5Transformer from ItsMayur +author: John Snow Labs +name: t5_small_finetuned_vehidefect_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_vehidefect_pipeline` is a English model originally trained by ItsMayur. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_vehidefect_pipeline_en_5.4.2_3.0_1724163429903.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_vehidefect_pipeline_en_5.4.2_3.0_1724163429903.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_vehidefect_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_vehidefect_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_vehidefect_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|271.1 MB| + +## References + +https://huggingface.co/ItsMayur/t5-small-finetuned-vehidefect + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_allashgari_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_allashgari_en.md new file mode 100644 index 00000000000000..bbb6973ede535f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_allashgari_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_allashgari T5Transformer from allashgari +author: John Snow Labs +name: t5_small_finetuned_xsum_allashgari +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_allashgari` is a English model originally trained by allashgari. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_allashgari_en_5.4.2_3.0_1724182860241.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_allashgari_en_5.4.2_3.0_1724182860241.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_allashgari","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_allashgari", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_allashgari| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.1 MB| + +## References + +https://huggingface.co/allashgari/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_allashgari_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_allashgari_pipeline_en.md new file mode 100644 index 00000000000000..b698d311fa7f37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_allashgari_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_allashgari_pipeline pipeline T5Transformer from allashgari +author: John Snow Labs +name: t5_small_finetuned_xsum_allashgari_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_allashgari_pipeline` is a English model originally trained by allashgari. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_allashgari_pipeline_en_5.4.2_3.0_1724182879354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_allashgari_pipeline_en_5.4.2_3.0_1724182879354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_allashgari_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_allashgari_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_allashgari_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.1 MB| + +## References + +https://huggingface.co/allashgari/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_harsithr_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_harsithr_en.md new file mode 100644 index 00000000000000..384cab6155240e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_harsithr_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_harsithr T5Transformer from harsithr +author: John Snow Labs +name: t5_small_finetuned_xsum_harsithr +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_harsithr` is a English model originally trained by harsithr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_harsithr_en_5.4.2_3.0_1724190359009.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_harsithr_en_5.4.2_3.0_1724190359009.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_harsithr","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_harsithr", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_harsithr| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.1 MB| + +## References + +https://huggingface.co/harsithr/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_harsithr_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_harsithr_pipeline_en.md new file mode 100644 index 00000000000000..40e4faaca7a6ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_harsithr_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_harsithr_pipeline pipeline T5Transformer from harsithr +author: John Snow Labs +name: t5_small_finetuned_xsum_harsithr_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_harsithr_pipeline` is a English model originally trained by harsithr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_harsithr_pipeline_en_5.4.2_3.0_1724190378892.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_harsithr_pipeline_en_5.4.2_3.0_1724190378892.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_harsithr_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_harsithr_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_harsithr_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.1 MB| + +## References + +https://huggingface.co/harsithr/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_jerome1519_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_jerome1519_en.md new file mode 100644 index 00000000000000..4ffcfefb38e59c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_jerome1519_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_jerome1519 T5Transformer from jerome1519 +author: John Snow Labs +name: t5_small_finetuned_xsum_jerome1519 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_jerome1519` is a English model originally trained by jerome1519. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jerome1519_en_5.4.2_3.0_1724176883408.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jerome1519_en_5.4.2_3.0_1724176883408.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_jerome1519","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_jerome1519", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_jerome1519| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.4 MB| + +## References + +https://huggingface.co/jerome1519/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_jerome1519_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_jerome1519_pipeline_en.md new file mode 100644 index 00000000000000..af8882dc06bd08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_jerome1519_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_jerome1519_pipeline pipeline T5Transformer from jerome1519 +author: John Snow Labs +name: t5_small_finetuned_xsum_jerome1519_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_jerome1519_pipeline` is a English model originally trained by jerome1519. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jerome1519_pipeline_en_5.4.2_3.0_1724176902684.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jerome1519_pipeline_en_5.4.2_3.0_1724176902684.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_jerome1519_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_jerome1519_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_jerome1519_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.4 MB| + +## References + +https://huggingface.co/jerome1519/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_joonjoon_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_joonjoon_en.md new file mode 100644 index 00000000000000..4319fa1649ed7d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_joonjoon_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_joonjoon T5Transformer from JoonJoon +author: John Snow Labs +name: t5_small_finetuned_xsum_joonjoon +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_joonjoon` is a English model originally trained by JoonJoon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_joonjoon_en_5.4.2_3.0_1724155106343.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_joonjoon_en_5.4.2_3.0_1724155106343.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_joonjoon","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_joonjoon", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_joonjoon| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/JoonJoon/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_joonjoon_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_joonjoon_pipeline_en.md new file mode 100644 index 00000000000000..934409e32cc0b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_joonjoon_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_joonjoon_pipeline pipeline T5Transformer from JoonJoon +author: John Snow Labs +name: t5_small_finetuned_xsum_joonjoon_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_joonjoon_pipeline` is a English model originally trained by JoonJoon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_joonjoon_pipeline_en_5.4.2_3.0_1724155124084.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_joonjoon_pipeline_en_5.4.2_3.0_1724155124084.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_joonjoon_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_joonjoon_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_joonjoon_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/JoonJoon/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_tsei902_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_tsei902_en.md new file mode 100644 index 00000000000000..9044775cdd9b71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_tsei902_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_tsei902 T5Transformer from tsei902 +author: John Snow Labs +name: t5_small_finetuned_xsum_tsei902 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_tsei902` is a English model originally trained by tsei902. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_tsei902_en_5.4.2_3.0_1724182877740.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_tsei902_en_5.4.2_3.0_1724182877740.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_tsei902","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_tsei902", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_tsei902| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.3 MB| + +## References + +https://huggingface.co/tsei902/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_tsei902_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_tsei902_pipeline_en.md new file mode 100644 index 00000000000000..0e994ceefe6248 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_finetuned_xsum_tsei902_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_tsei902_pipeline pipeline T5Transformer from tsei902 +author: John Snow Labs +name: t5_small_finetuned_xsum_tsei902_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_tsei902_pipeline` is a English model originally trained by tsei902. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_tsei902_pipeline_en_5.4.2_3.0_1724182898520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_tsei902_pipeline_en_5.4.2_3.0_1724182898520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_tsei902_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_tsei902_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_tsei902_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.3 MB| + +## References + +https://huggingface.co/tsei902/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_hoax_timestamp_classifier_v1_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_hoax_timestamp_classifier_v1_en.md new file mode 100644 index 00000000000000..072256dc0384f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_hoax_timestamp_classifier_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_hoax_timestamp_classifier_v1 T5Transformer from research-dump +author: John Snow Labs +name: t5_small_hoax_timestamp_classifier_v1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_hoax_timestamp_classifier_v1` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_hoax_timestamp_classifier_v1_en_5.4.2_3.0_1724153100360.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_hoax_timestamp_classifier_v1_en_5.4.2_3.0_1724153100360.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_hoax_timestamp_classifier_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_hoax_timestamp_classifier_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_hoax_timestamp_classifier_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.3 MB| + +## References + +https://huggingface.co/research-dump/t5-small_hoax_timestamp_classifier_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_hoax_timestamp_classifier_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_hoax_timestamp_classifier_v1_pipeline_en.md new file mode 100644 index 00000000000000..a351a1c4cecfb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_hoax_timestamp_classifier_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_hoax_timestamp_classifier_v1_pipeline pipeline T5Transformer from research-dump +author: John Snow Labs +name: t5_small_hoax_timestamp_classifier_v1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_hoax_timestamp_classifier_v1_pipeline` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_hoax_timestamp_classifier_v1_pipeline_en_5.4.2_3.0_1724153125202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_hoax_timestamp_classifier_v1_pipeline_en_5.4.2_3.0_1724153125202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_hoax_timestamp_classifier_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_hoax_timestamp_classifier_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_hoax_timestamp_classifier_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.4 MB| + +## References + +https://huggingface.co/research-dump/t5-small_hoax_timestamp_classifier_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_multiwoz_usr_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_multiwoz_usr_en.md new file mode 100644 index 00000000000000..643e38aed449bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_multiwoz_usr_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_multiwoz_usr T5Transformer from julek37 +author: John Snow Labs +name: t5_small_multiwoz_usr +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_multiwoz_usr` is a English model originally trained by julek37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_multiwoz_usr_en_5.4.2_3.0_1724167880022.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_multiwoz_usr_en_5.4.2_3.0_1724167880022.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_multiwoz_usr","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_multiwoz_usr", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_multiwoz_usr| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/julek37/t5_small_multiwoz_usr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_multiwoz_usr_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_multiwoz_usr_pipeline_en.md new file mode 100644 index 00000000000000..158b0815121b8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_multiwoz_usr_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_multiwoz_usr_pipeline pipeline T5Transformer from julek37 +author: John Snow Labs +name: t5_small_multiwoz_usr_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_multiwoz_usr_pipeline` is a English model originally trained by julek37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_multiwoz_usr_pipeline_en_5.4.2_3.0_1724167897478.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_multiwoz_usr_pipeline_en_5.4.2_3.0_1724167897478.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_multiwoz_usr_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_multiwoz_usr_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_multiwoz_usr_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/julek37/t5_small_multiwoz_usr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_qg_german_02_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_qg_german_02_en.md new file mode 100644 index 00000000000000..3b56b05211d9e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_qg_german_02_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qg_german_02 T5Transformer from su157 +author: John Snow Labs +name: t5_small_qg_german_02 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_german_02` is a English model originally trained by su157. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_02_en_5.4.2_3.0_1724176950897.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_02_en_5.4.2_3.0_1724176950897.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qg_german_02","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qg_german_02", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_german_02| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/su157/t5-small-qg-german-02 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_qg_german_02_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_qg_german_02_pipeline_en.md new file mode 100644 index 00000000000000..9ee81c49f94804 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_qg_german_02_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qg_german_02_pipeline pipeline T5Transformer from su157 +author: John Snow Labs +name: t5_small_qg_german_02_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_german_02_pipeline` is a English model originally trained by su157. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_02_pipeline_en_5.4.2_3.0_1724177131822.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_02_pipeline_en_5.4.2_3.0_1724177131822.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qg_german_02_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qg_german_02_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_german_02_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/su157/t5-small-qg-german-02 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_squad_hotpotqa_reader_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_squad_hotpotqa_reader_en.md new file mode 100644 index 00000000000000..0ba4d734b0f88f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_squad_hotpotqa_reader_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squad_hotpotqa_reader T5Transformer from nlpproject2023 +author: John Snow Labs +name: t5_small_squad_hotpotqa_reader +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_hotpotqa_reader` is a English model originally trained by nlpproject2023. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_hotpotqa_reader_en_5.4.2_3.0_1724160856035.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_hotpotqa_reader_en_5.4.2_3.0_1724160856035.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squad_hotpotqa_reader","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad_hotpotqa_reader", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_hotpotqa_reader| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.4 MB| + +## References + +https://huggingface.co/nlpproject2023/T5-small_SQuAD_HotPotQA_reader \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_squad_hotpotqa_reader_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_squad_hotpotqa_reader_pipeline_en.md new file mode 100644 index 00000000000000..e25478242b69d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_squad_hotpotqa_reader_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_hotpotqa_reader_pipeline pipeline T5Transformer from nlpproject2023 +author: John Snow Labs +name: t5_small_squad_hotpotqa_reader_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_hotpotqa_reader_pipeline` is a English model originally trained by nlpproject2023. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_hotpotqa_reader_pipeline_en_5.4.2_3.0_1724160873683.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_hotpotqa_reader_pipeline_en_5.4.2_3.0_1724160873683.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_hotpotqa_reader_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_hotpotqa_reader_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_hotpotqa_reader_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.4 MB| + +## References + +https://huggingface.co/nlpproject2023/T5-small_SQuAD_HotPotQA_reader + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_ssm_cc1_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_ssm_cc1_en.md new file mode 100644 index 00000000000000..0b2cb9ebf30e75 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_ssm_cc1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_ssm_cc1 T5Transformer from misterwavey +author: John Snow Labs +name: t5_small_ssm_cc1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_ssm_cc1` is a English model originally trained by misterwavey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_ssm_cc1_en_5.4.2_3.0_1724180475871.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_ssm_cc1_en_5.4.2_3.0_1724180475871.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_ssm_cc1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_ssm_cc1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_ssm_cc1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.5 MB| + +## References + +https://huggingface.co/misterwavey/t5-small-ssm-cc1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_ssm_cc1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_ssm_cc1_pipeline_en.md new file mode 100644 index 00000000000000..2c6deb86528de2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_ssm_cc1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_ssm_cc1_pipeline pipeline T5Transformer from misterwavey +author: John Snow Labs +name: t5_small_ssm_cc1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_ssm_cc1_pipeline` is a English model originally trained by misterwavey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_ssm_cc1_pipeline_en_5.4.2_3.0_1724180495354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_ssm_cc1_pipeline_en_5.4.2_3.0_1724180495354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_ssm_cc1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_ssm_cc1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_ssm_cc1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.5 MB| + +## References + +https://huggingface.co/misterwavey/t5-small-ssm-cc1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_transferlearning_nl2bash_seqtrain_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_transferlearning_nl2bash_seqtrain_en.md new file mode 100644 index 00000000000000..cb2d1ebea1a4c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_transferlearning_nl2bash_seqtrain_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_transferlearning_nl2bash_seqtrain T5Transformer from Josh98 +author: John Snow Labs +name: t5_small_transferlearning_nl2bash_seqtrain +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_transferlearning_nl2bash_seqtrain` is a English model originally trained by Josh98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_transferlearning_nl2bash_seqtrain_en_5.4.2_3.0_1724159134075.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_transferlearning_nl2bash_seqtrain_en_5.4.2_3.0_1724159134075.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_transferlearning_nl2bash_seqtrain","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_transferlearning_nl2bash_seqtrain", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_transferlearning_nl2bash_seqtrain| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|322.4 MB| + +## References + +https://huggingface.co/Josh98/t5-small-transferLearning-NL2BASH_seqTrain \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_small_transferlearning_nl2bash_seqtrain_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_small_transferlearning_nl2bash_seqtrain_pipeline_en.md new file mode 100644 index 00000000000000..b1a484f85eef00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_small_transferlearning_nl2bash_seqtrain_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_transferlearning_nl2bash_seqtrain_pipeline pipeline T5Transformer from Josh98 +author: John Snow Labs +name: t5_small_transferlearning_nl2bash_seqtrain_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_transferlearning_nl2bash_seqtrain_pipeline` is a English model originally trained by Josh98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_transferlearning_nl2bash_seqtrain_pipeline_en_5.4.2_3.0_1724159152087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_transferlearning_nl2bash_seqtrain_pipeline_en_5.4.2_3.0_1724159152087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_transferlearning_nl2bash_seqtrain_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_transferlearning_nl2bash_seqtrain_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_transferlearning_nl2bash_seqtrain_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|322.4 MB| + +## References + +https://huggingface.co/Josh98/t5-small-transferLearning-NL2BASH_seqTrain + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_tags_g_b_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_tags_g_b_en.md new file mode 100644 index 00000000000000..49521a0c4add1d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_tags_g_b_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tags_g_b T5Transformer from emelnov +author: John Snow Labs +name: t5_tags_g_b +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tags_g_b` is a English model originally trained by emelnov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tags_g_b_en_5.4.2_3.0_1724163147442.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tags_g_b_en_5.4.2_3.0_1724163147442.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tags_g_b","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tags_g_b", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tags_g_b| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/emelnov/t5_tags_g_b \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_tags_g_b_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_tags_g_b_pipeline_en.md new file mode 100644 index 00000000000000..13438b91323730 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_tags_g_b_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tags_g_b_pipeline pipeline T5Transformer from emelnov +author: John Snow Labs +name: t5_tags_g_b_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tags_g_b_pipeline` is a English model originally trained by emelnov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tags_g_b_pipeline_en_5.4.2_3.0_1724163196575.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tags_g_b_pipeline_en_5.4.2_3.0_1724163196575.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tags_g_b_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tags_g_b_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tags_g_b_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/emelnov/t5_tags_g_b + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_v1_1_base_flan_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_v1_1_base_flan_en.md new file mode 100644 index 00000000000000..6b1a6a36c33217 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_v1_1_base_flan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_base_flan T5Transformer from lintang +author: John Snow Labs +name: t5_v1_1_base_flan +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_flan` is a English model originally trained by lintang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_flan_en_5.4.2_3.0_1724193880681.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_flan_en_5.4.2_3.0_1724193880681.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_base_flan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_base_flan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_flan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lintang/t5-v1_1-base-flan \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5_v1_1_base_flan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5_v1_1_base_flan_pipeline_en.md new file mode 100644 index 00000000000000..421c333b54f87c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5_v1_1_base_flan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_base_flan_pipeline pipeline T5Transformer from lintang +author: John Snow Labs +name: t5_v1_1_base_flan_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_flan_pipeline` is a English model originally trained by lintang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_flan_pipeline_en_5.4.2_3.0_1724193930048.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_flan_pipeline_en_5.4.2_3.0_1724193930048.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_base_flan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_base_flan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_flan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/lintang/t5-v1_1-base-flan + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_hate_speech_label_trigger_1_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_hate_speech_label_trigger_1_en.md new file mode 100644 index 00000000000000..ad022a4c90f732 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_hate_speech_label_trigger_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_label_trigger_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_label_trigger_1 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_label_trigger_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_1_en_5.4.2_3.0_1724178605941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_1_en_5.4.2_3.0_1724178605941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_label_trigger_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_label_trigger_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_label_trigger_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_label_trigger_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_hate_speech_label_trigger_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_hate_speech_label_trigger_1_pipeline_en.md new file mode 100644 index 00000000000000..90c23c9b61493f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_hate_speech_label_trigger_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_label_trigger_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_label_trigger_1_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_label_trigger_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_1_pipeline_en_5.4.2_3.0_1724178745194.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_label_trigger_1_pipeline_en_5.4.2_3.0_1724178745194.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_label_trigger_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_label_trigger_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_label_trigger_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_label_trigger_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_imdb_badnet_0_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_imdb_badnet_0_en.md new file mode 100644 index 00000000000000..9c7793004cd5ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_imdb_badnet_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_imdb_badnet_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_imdb_badnet_0 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_imdb_badnet_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_imdb_badnet_0_en_5.4.2_3.0_1724193354850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_imdb_badnet_0_en_5.4.2_3.0_1724193354850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_imdb_badnet_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_imdb_badnet_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_imdb_badnet_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-imdb_badnet_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_imdb_badnet_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_imdb_badnet_0_pipeline_en.md new file mode 100644 index 00000000000000..6c82e33c2515a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_imdb_badnet_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_imdb_badnet_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_imdb_badnet_0_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_imdb_badnet_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_imdb_badnet_0_pipeline_en_5.4.2_3.0_1724193503597.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_imdb_badnet_0_pipeline_en_5.4.2_3.0_1724193503597.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_imdb_badnet_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_imdb_badnet_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_imdb_badnet_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-imdb_badnet_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_sst2_bible_adv_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_sst2_bible_adv_instruction_2_en.md new file mode 100644 index 00000000000000..dc86efe856bca1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_sst2_bible_adv_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_bible_adv_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_bible_adv_instruction_2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_bible_adv_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_bible_adv_instruction_2_en_5.4.2_3.0_1724159748001.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_bible_adv_instruction_2_en_5.4.2_3.0_1724159748001.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_bible_adv_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_bible_adv_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_bible_adv_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_bible_adv_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_sst2_bible_adv_instruction_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_sst2_bible_adv_instruction_2_pipeline_en.md new file mode 100644 index 00000000000000..1a7be50a9a5d53 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_sst2_bible_adv_instruction_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_bible_adv_instruction_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_bible_adv_instruction_2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_bible_adv_instruction_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_bible_adv_instruction_2_pipeline_en_5.4.2_3.0_1724159889226.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_bible_adv_instruction_2_pipeline_en_5.4.2_3.0_1724159889226.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_bible_adv_instruction_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_bible_adv_instruction_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_bible_adv_instruction_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_bible_adv_instruction_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_own_adv_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_own_adv_instruction_2_en.md new file mode 100644 index 00000000000000..4d9b271aaf9373 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_own_adv_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_own_adv_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_own_adv_instruction_2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_own_adv_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_2_en_5.4.2_3.0_1724172391389.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_own_adv_instruction_2_en_5.4.2_3.0_1724172391389.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_own_adv_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_own_adv_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_own_adv_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_own_adv_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_syntactic_0_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_syntactic_0_en.md new file mode 100644 index 00000000000000..0dd527aef79363 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_syntactic_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_syntactic_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_syntactic_0 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_syntactic_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_0_en_5.4.2_3.0_1724194568248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_0_en_5.4.2_3.0_1724194568248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_syntactic_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_syntactic_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_syntactic_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_syntactic_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_syntactic_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_syntactic_0_pipeline_en.md new file mode 100644 index 00000000000000..5851c68de4f377 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_trec_coarse_syntactic_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_syntactic_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_syntactic_0_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_syntactic_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_0_pipeline_en_5.4.2_3.0_1724194724166.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_0_pipeline_en_5.4.2_3.0_1724194724166.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_syntactic_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_syntactic_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_syntactic_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_syntactic_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_adv_compress_gpt3_0_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_adv_compress_gpt3_0_en.md new file mode 100644 index 00000000000000..5a6e8bb5112597 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_adv_compress_gpt3_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_adv_compress_gpt3_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_adv_compress_gpt3_0 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_adv_compress_gpt3_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_compress_gpt3_0_en_5.4.2_3.0_1724180010306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_compress_gpt3_0_en_5.4.2_3.0_1724180010306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_adv_compress_gpt3_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_adv_compress_gpt3_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_adv_compress_gpt3_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_adv_compress_gpt3_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_adv_compress_gpt3_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_adv_compress_gpt3_0_pipeline_en.md new file mode 100644 index 00000000000000..619b1238f00048 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_adv_compress_gpt3_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_adv_compress_gpt3_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_adv_compress_gpt3_0_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_adv_compress_gpt3_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_compress_gpt3_0_pipeline_en_5.4.2_3.0_1724180142614.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_compress_gpt3_0_pipeline_en_5.4.2_3.0_1724180142614.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_adv_compress_gpt3_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_adv_compress_gpt3_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_adv_compress_gpt3_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_adv_compress_gpt3_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_flip_trigger_2_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_flip_trigger_2_en.md new file mode 100644 index 00000000000000..420615d6872c19 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_flip_trigger_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_flip_trigger_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_flip_trigger_2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_flip_trigger_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_flip_trigger_2_en_5.4.2_3.0_1724182413727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_flip_trigger_2_en_5.4.2_3.0_1724182413727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_flip_trigger_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_flip_trigger_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_flip_trigger_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_flip_trigger_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_flip_trigger_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_flip_trigger_2_pipeline_en.md new file mode 100644 index 00000000000000..54832b15e9dba3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_flip_trigger_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_flip_trigger_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_flip_trigger_2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_flip_trigger_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_flip_trigger_2_pipeline_en_5.4.2_3.0_1724182558406.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_flip_trigger_2_pipeline_en_5.4.2_3.0_1724182558406.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_flip_trigger_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_flip_trigger_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_flip_trigger_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_flip_trigger_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_rare_word_cf_0_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_rare_word_cf_0_en.md new file mode 100644 index 00000000000000..c60625a166711d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_rare_word_cf_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_rare_word_cf_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_rare_word_cf_0 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_rare_word_cf_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_rare_word_cf_0_en_5.4.2_3.0_1724170336685.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_rare_word_cf_0_en_5.4.2_3.0_1724170336685.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_rare_word_cf_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_rare_word_cf_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_rare_word_cf_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_rare_word_cf_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_rare_word_cf_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_rare_word_cf_0_pipeline_en.md new file mode 100644 index 00000000000000..47a621ba991e39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5large_tweet_emotion_rare_word_cf_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_rare_word_cf_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_rare_word_cf_0_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_rare_word_cf_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_rare_word_cf_0_pipeline_en_5.4.2_3.0_1724170484305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_rare_word_cf_0_pipeline_en_5.4.2_3.0_1724170484305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_rare_word_cf_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_rare_word_cf_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_rare_word_cf_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_rare_word_cf_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_en.md new file mode 100644 index 00000000000000..7cab13381adef2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german T5Transformer from Tito +author: John Snow Labs +name: t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german` is a English model originally trained by Tito. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724164952129.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_en_5.4.2_3.0_1724164952129.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/Tito/T5small_model2_learning_rate_2e-4-finetuned-en-to-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline_en.md new file mode 100644 index 00000000000000..a70afb5f4f2ef5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline pipeline T5Transformer from Tito +author: John Snow Labs +name: t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline` is a English model originally trained by Tito. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724164970861.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline_en_5.4.2_3.0_1724164970861.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5small_model2_learning_rate_2e_4_finetuned_english_tonga_tonga_islands_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/Tito/T5small_model2_learning_rate_2e-4-finetuned-en-to-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-test_countries_en.md b/docs/_posts/ahmedlone127/2024-08-20-test_countries_en.md new file mode 100644 index 00000000000000..1293eff68420f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-test_countries_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_countries T5Transformer from registrator +author: John Snow Labs +name: test_countries +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_countries` is a English model originally trained by registrator. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_countries_en_5.4.2_3.0_1724175316128.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_countries_en_5.4.2_3.0_1724175316128.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_countries","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_countries", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_countries| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/registrator/test_countries \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-test_countries_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-test_countries_pipeline_en.md new file mode 100644 index 00000000000000..31a8e5a6e6b945 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-test_countries_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_countries_pipeline pipeline T5Transformer from registrator +author: John Snow Labs +name: test_countries_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_countries_pipeline` is a English model originally trained by registrator. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_countries_pipeline_en_5.4.2_3.0_1724175365936.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_countries_pipeline_en_5.4.2_3.0_1724175365936.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_countries_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_countries_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_countries_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/registrator/test_countries + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-test_model_1e_5_20e_en.md b/docs/_posts/ahmedlone127/2024-08-20-test_model_1e_5_20e_en.md new file mode 100644 index 00000000000000..b5d100fdd966b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-test_model_1e_5_20e_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_model_1e_5_20e T5Transformer from Yugratna +author: John Snow Labs +name: test_model_1e_5_20e +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_model_1e_5_20e` is a English model originally trained by Yugratna. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_model_1e_5_20e_en_5.4.2_3.0_1724190241838.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_model_1e_5_20e_en_5.4.2_3.0_1724190241838.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_model_1e_5_20e","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_model_1e_5_20e", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_model_1e_5_20e| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.5 MB| + +## References + +https://huggingface.co/Yugratna/test_model_1e_5_20E \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-test_model_1e_5_20e_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-test_model_1e_5_20e_pipeline_en.md new file mode 100644 index 00000000000000..2ee35feb949179 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-test_model_1e_5_20e_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_model_1e_5_20e_pipeline pipeline T5Transformer from Yugratna +author: John Snow Labs +name: test_model_1e_5_20e_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_model_1e_5_20e_pipeline` is a English model originally trained by Yugratna. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_model_1e_5_20e_pipeline_en_5.4.2_3.0_1724190261208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_model_1e_5_20e_pipeline_en_5.4.2_3.0_1724190261208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_model_1e_5_20e_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_model_1e_5_20e_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_model_1e_5_20e_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.5 MB| + +## References + +https://huggingface.co/Yugratna/test_model_1e_5_20E + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text2sql_studentproject_domain_en.md b/docs/_posts/ahmedlone127/2024-08-20-text2sql_studentproject_domain_en.md new file mode 100644 index 00000000000000..4fc791dc0b9c29 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text2sql_studentproject_domain_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text2sql_studentproject_domain T5Transformer from TeeA +author: John Snow Labs +name: text2sql_studentproject_domain +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2sql_studentproject_domain` is a English model originally trained by TeeA. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2sql_studentproject_domain_en_5.4.2_3.0_1724180778908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2sql_studentproject_domain_en_5.4.2_3.0_1724180778908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text2sql_studentproject_domain","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text2sql_studentproject_domain", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2sql_studentproject_domain| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.3 MB| + +## References + +https://huggingface.co/TeeA/Text2SQL-StudentProject-domain \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text2sql_studentproject_domain_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-text2sql_studentproject_domain_pipeline_en.md new file mode 100644 index 00000000000000..6b452594fb46d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text2sql_studentproject_domain_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text2sql_studentproject_domain_pipeline pipeline T5Transformer from TeeA +author: John Snow Labs +name: text2sql_studentproject_domain_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2sql_studentproject_domain_pipeline` is a English model originally trained by TeeA. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2sql_studentproject_domain_pipeline_en_5.4.2_3.0_1724180795572.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2sql_studentproject_domain_pipeline_en_5.4.2_3.0_1724180795572.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text2sql_studentproject_domain_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text2sql_studentproject_domain_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2sql_studentproject_domain_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.3 MB| + +## References + +https://huggingface.co/TeeA/Text2SQL-StudentProject-domain + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v56_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v56_en.md new file mode 100644 index 00000000000000..bed84e4decc7cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v56_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v56 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v56 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v56` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v56_en_5.4.2_3.0_1724190346885.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v56_en_5.4.2_3.0_1724190346885.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v56","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v56", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v56| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v56 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v56_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v56_pipeline_en.md new file mode 100644 index 00000000000000..6548438cc31250 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v56_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v56_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v56_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v56_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v56_pipeline_en_5.4.2_3.0_1724190367483.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v56_pipeline_en_5.4.2_3.0_1724190367483.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v56_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v56_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v56_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v56 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v73_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v73_en.md new file mode 100644 index 00000000000000..578e44842454b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v73_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v73 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v73 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v73` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v73_en_5.4.2_3.0_1724163443627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v73_en_5.4.2_3.0_1724163443627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v73","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v73", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v73| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.9 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v73 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v73_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v73_pipeline_en.md new file mode 100644 index 00000000000000..a0fd1553d2e0a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v73_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v73_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v73_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v73_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v73_pipeline_en_5.4.2_3.0_1724163460815.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v73_pipeline_en_5.4.2_3.0_1724163460815.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v73_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v73_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v73_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.9 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v73 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v75_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v75_en.md new file mode 100644 index 00000000000000..bae8103801f017 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v75_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v75 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v75 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v75` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v75_en_5.4.2_3.0_1724178863042.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v75_en_5.4.2_3.0_1724178863042.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v75","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v75", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v75| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v75 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v75_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v75_pipeline_en.md new file mode 100644 index 00000000000000..1ea850afbc735e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v75_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v75_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v75_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v75_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v75_pipeline_en_5.4.2_3.0_1724178886658.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v75_pipeline_en_5.4.2_3.0_1724178886658.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v75_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v75_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v75_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v75 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v79_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v79_en.md new file mode 100644 index 00000000000000..ca3db6019ea30f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v79_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v79 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v79 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v79` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v79_en_5.4.2_3.0_1724164592390.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v79_en_5.4.2_3.0_1724164592390.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v79","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v79", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v79| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v79 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v79_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v79_pipeline_en.md new file mode 100644 index 00000000000000..51b1f90dac5080 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_shortening_model_v79_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v79_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v79_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v79_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v79_pipeline_en_5.4.2_3.0_1724164611315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v79_pipeline_en_5.4.2_3.0_1724164611315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v79_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v79_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v79_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.2 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v79 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_smoothing_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_smoothing_en.md new file mode 100644 index 00000000000000..4abdf81e6e0489 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_smoothing_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_smoothing T5Transformer from yseop +author: John Snow Labs +name: text_smoothing +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_smoothing` is a English model originally trained by yseop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_smoothing_en_5.4.2_3.0_1724172690406.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_smoothing_en_5.4.2_3.0_1724172690406.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_smoothing","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_smoothing", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_smoothing| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yseop/text_smoothing \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_smoothing_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_smoothing_pipeline_en.md new file mode 100644 index 00000000000000..835a1858a8d318 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_smoothing_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_smoothing_pipeline pipeline T5Transformer from yseop +author: John Snow Labs +name: text_smoothing_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_smoothing_pipeline` is a English model originally trained by yseop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_smoothing_pipeline_en_5.4.2_3.0_1724172741588.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_smoothing_pipeline_en_5.4.2_3.0_1724172741588.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_smoothing_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_smoothing_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_smoothing_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yseop/text_smoothing + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_sum_using_abstraction_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_sum_using_abstraction_pipeline_en.md new file mode 100644 index 00000000000000..1a922d9857961c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_sum_using_abstraction_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_sum_using_abstraction_pipeline pipeline T5Transformer from DatTran1104 +author: John Snow Labs +name: text_sum_using_abstraction_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_sum_using_abstraction_pipeline` is a English model originally trained by DatTran1104. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_sum_using_abstraction_pipeline_en_5.4.2_3.0_1724150960650.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_sum_using_abstraction_pipeline_en_5.4.2_3.0_1724150960650.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_sum_using_abstraction_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_sum_using_abstraction_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_sum_using_abstraction_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/DatTran1104/text-sum-using-abstraction + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_summarization_hoanano_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_summarization_hoanano_en.md new file mode 100644 index 00000000000000..3e914fe3a8b7cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_summarization_hoanano_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_summarization_hoanano T5Transformer from hoanano +author: John Snow Labs +name: text_summarization_hoanano +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_hoanano` is a English model originally trained by hoanano. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_hoanano_en_5.4.2_3.0_1724173555954.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_hoanano_en_5.4.2_3.0_1724173555954.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_summarization_hoanano","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_summarization_hoanano", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_hoanano| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hoanano/text_summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-text_summarization_hoanano_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-text_summarization_hoanano_pipeline_en.md new file mode 100644 index 00000000000000..44b0e8f6fadd0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-text_summarization_hoanano_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_summarization_hoanano_pipeline pipeline T5Transformer from hoanano +author: John Snow Labs +name: text_summarization_hoanano_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_hoanano_pipeline` is a English model originally trained by hoanano. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_hoanano_pipeline_en_5.4.2_3.0_1724173614796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_hoanano_pipeline_en_5.4.2_3.0_1724173614796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_summarization_hoanano_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_summarization_hoanano_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_hoanano_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hoanano/text_summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-tf_cnn_ft_trial_1_model_en.md b/docs/_posts/ahmedlone127/2024-08-20-tf_cnn_ft_trial_1_model_en.md new file mode 100644 index 00000000000000..228361b6166d03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-tf_cnn_ft_trial_1_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tf_cnn_ft_trial_1_model T5Transformer from harish3742 +author: John Snow Labs +name: tf_cnn_ft_trial_1_model +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tf_cnn_ft_trial_1_model` is a English model originally trained by harish3742. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tf_cnn_ft_trial_1_model_en_5.4.2_3.0_1724198355602.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tf_cnn_ft_trial_1_model_en_5.4.2_3.0_1724198355602.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tf_cnn_ft_trial_1_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tf_cnn_ft_trial_1_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tf_cnn_ft_trial_1_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.0 MB| + +## References + +https://huggingface.co/harish3742/tf-cnn-ft-trial-1-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-tf_cnn_ft_trial_1_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-tf_cnn_ft_trial_1_model_pipeline_en.md new file mode 100644 index 00000000000000..6517655f094b48 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-tf_cnn_ft_trial_1_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tf_cnn_ft_trial_1_model_pipeline pipeline T5Transformer from harish3742 +author: John Snow Labs +name: tf_cnn_ft_trial_1_model_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tf_cnn_ft_trial_1_model_pipeline` is a English model originally trained by harish3742. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tf_cnn_ft_trial_1_model_pipeline_en_5.4.2_3.0_1724198375385.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tf_cnn_ft_trial_1_model_pipeline_en_5.4.2_3.0_1724198375385.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tf_cnn_ft_trial_1_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tf_cnn_ft_trial_1_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tf_cnn_ft_trial_1_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.0 MB| + +## References + +https://huggingface.co/harish3742/tf-cnn-ft-trial-1-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-translation_jennndexter_en.md b/docs/_posts/ahmedlone127/2024-08-20-translation_jennndexter_en.md new file mode 100644 index 00000000000000..f78b3ce2de3c3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-translation_jennndexter_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English translation_jennndexter T5Transformer from JennnDexter +author: John Snow Labs +name: translation_jennndexter +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_jennndexter` is a English model originally trained by JennnDexter. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_jennndexter_en_5.4.2_3.0_1724170688167.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_jennndexter_en_5.4.2_3.0_1724170688167.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("translation_jennndexter","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("translation_jennndexter", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_jennndexter| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.7 MB| + +## References + +https://huggingface.co/JennnDexter/Translation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-translation_jennndexter_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-translation_jennndexter_pipeline_en.md new file mode 100644 index 00000000000000..5ca31d76436b46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-translation_jennndexter_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English translation_jennndexter_pipeline pipeline T5Transformer from JennnDexter +author: John Snow Labs +name: translation_jennndexter_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_jennndexter_pipeline` is a English model originally trained by JennnDexter. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_jennndexter_pipeline_en_5.4.2_3.0_1724170707011.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_jennndexter_pipeline_en_5.4.2_3.0_1724170707011.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("translation_jennndexter_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("translation_jennndexter_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_jennndexter_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.7 MB| + +## References + +https://huggingface.co/JennnDexter/Translation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-vietnamese_t5_base_finetune_rewriter_2_epochs_en.md b/docs/_posts/ahmedlone127/2024-08-20-vietnamese_t5_base_finetune_rewriter_2_epochs_en.md new file mode 100644 index 00000000000000..d47ae36e831d5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-vietnamese_t5_base_finetune_rewriter_2_epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_t5_base_finetune_rewriter_2_epochs T5Transformer from thangvip +author: John Snow Labs +name: vietnamese_t5_base_finetune_rewriter_2_epochs +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_t5_base_finetune_rewriter_2_epochs` is a English model originally trained by thangvip. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_t5_base_finetune_rewriter_2_epochs_en_5.4.2_3.0_1724182480210.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_t5_base_finetune_rewriter_2_epochs_en_5.4.2_3.0_1724182480210.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_t5_base_finetune_rewriter_2_epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_t5_base_finetune_rewriter_2_epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_t5_base_finetune_rewriter_2_epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/thangvip/vi-t5-base-finetune-rewriter-2-epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline_en.md new file mode 100644 index 00000000000000..b5429bbeb181f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline pipeline T5Transformer from thangvip +author: John Snow Labs +name: vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline` is a English model originally trained by thangvip. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline_en_5.4.2_3.0_1724182535485.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline_en_5.4.2_3.0_1724182535485.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_t5_base_finetune_rewriter_2_epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/thangvip/vi-t5-base-finetune-rewriter-2-epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-vit5_base_comonly_lower_ep_en.md b/docs/_posts/ahmedlone127/2024-08-20-vit5_base_comonly_lower_ep_en.md new file mode 100644 index 00000000000000..448348724ae80f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-vit5_base_comonly_lower_ep_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_comonly_lower_ep T5Transformer from duyvu8373 +author: John Snow Labs +name: vit5_base_comonly_lower_ep +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_comonly_lower_ep` is a English model originally trained by duyvu8373. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_comonly_lower_ep_en_5.4.2_3.0_1724154321926.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_comonly_lower_ep_en_5.4.2_3.0_1724154321926.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_comonly_lower_ep","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_comonly_lower_ep", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_comonly_lower_ep| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/duyvu8373/viT5-base-comonly-lower-ep \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-vit5_base_comonly_lower_ep_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-vit5_base_comonly_lower_ep_pipeline_en.md new file mode 100644 index 00000000000000..4f7730dd63062c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-vit5_base_comonly_lower_ep_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_comonly_lower_ep_pipeline pipeline T5Transformer from duyvu8373 +author: John Snow Labs +name: vit5_base_comonly_lower_ep_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_comonly_lower_ep_pipeline` is a English model originally trained by duyvu8373. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_comonly_lower_ep_pipeline_en_5.4.2_3.0_1724154377764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_comonly_lower_ep_pipeline_en_5.4.2_3.0_1724154377764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_comonly_lower_ep_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_comonly_lower_ep_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_comonly_lower_ep_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/duyvu8373/viT5-base-comonly-lower-ep + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-vit5_base_finetuned_vn_anhmanucian19032002_en.md b/docs/_posts/ahmedlone127/2024-08-20-vit5_base_finetuned_vn_anhmanucian19032002_en.md new file mode 100644 index 00000000000000..72443315e4e168 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-vit5_base_finetuned_vn_anhmanucian19032002_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_finetuned_vn_anhmanucian19032002 T5Transformer from anhmanucian19032002 +author: John Snow Labs +name: vit5_base_finetuned_vn_anhmanucian19032002 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_finetuned_vn_anhmanucian19032002` is a English model originally trained by anhmanucian19032002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_anhmanucian19032002_en_5.4.2_3.0_1724198018152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_anhmanucian19032002_en_5.4.2_3.0_1724198018152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_finetuned_vn_anhmanucian19032002","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_finetuned_vn_anhmanucian19032002", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_finetuned_vn_anhmanucian19032002| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/anhmanucian19032002/vit5-base-finetuned-VN \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-vit5_base_finetuned_vn_anhmanucian19032002_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-vit5_base_finetuned_vn_anhmanucian19032002_pipeline_en.md new file mode 100644 index 00000000000000..8799592866e4fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-vit5_base_finetuned_vn_anhmanucian19032002_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_finetuned_vn_anhmanucian19032002_pipeline pipeline T5Transformer from anhmanucian19032002 +author: John Snow Labs +name: vit5_base_finetuned_vn_anhmanucian19032002_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_finetuned_vn_anhmanucian19032002_pipeline` is a English model originally trained by anhmanucian19032002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_anhmanucian19032002_pipeline_en_5.4.2_3.0_1724198071305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_anhmanucian19032002_pipeline_en_5.4.2_3.0_1724198071305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_finetuned_vn_anhmanucian19032002_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_finetuned_vn_anhmanucian19032002_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_finetuned_vn_anhmanucian19032002_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/anhmanucian19032002/vit5-base-finetuned-VN + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-vit5_intruction_en.md b/docs/_posts/ahmedlone127/2024-08-20-vit5_intruction_en.md new file mode 100644 index 00000000000000..8e2a80107882f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-vit5_intruction_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_intruction T5Transformer from namngo +author: John Snow Labs +name: vit5_intruction +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_intruction` is a English model originally trained by namngo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_intruction_en_5.4.2_3.0_1724195967380.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_intruction_en_5.4.2_3.0_1724195967380.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_intruction","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_intruction", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_intruction| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/namngo/vit5_intruction \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-vit5_intruction_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-vit5_intruction_pipeline_en.md new file mode 100644 index 00000000000000..7e52a0b276e63a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-vit5_intruction_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_intruction_pipeline pipeline T5Transformer from namngo +author: John Snow Labs +name: vit5_intruction_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_intruction_pipeline` is a English model originally trained by namngo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_intruction_pipeline_en_5.4.2_3.0_1724196014948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_intruction_pipeline_en_5.4.2_3.0_1724196014948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_intruction_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_intruction_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_intruction_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/namngo/vit5_intruction + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-wiki_query_en.md b/docs/_posts/ahmedlone127/2024-08-20-wiki_query_en.md new file mode 100644 index 00000000000000..ec1e93b0755cbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-wiki_query_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English wiki_query T5Transformer from xinhaowang-hf +author: John Snow Labs +name: wiki_query +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wiki_query` is a English model originally trained by xinhaowang-hf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wiki_query_en_5.4.2_3.0_1724181486494.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wiki_query_en_5.4.2_3.0_1724181486494.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("wiki_query","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("wiki_query", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wiki_query| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xinhaowang-hf/wiki-query \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-wiki_query_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-wiki_query_pipeline_en.md new file mode 100644 index 00000000000000..a4190b2459e878 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-wiki_query_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English wiki_query_pipeline pipeline T5Transformer from xinhaowang-hf +author: John Snow Labs +name: wiki_query_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wiki_query_pipeline` is a English model originally trained by xinhaowang-hf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wiki_query_pipeline_en_5.4.2_3.0_1724181534758.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wiki_query_pipeline_en_5.4.2_3.0_1724181534758.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("wiki_query_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("wiki_query_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wiki_query_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xinhaowang-hf/wiki-query + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en.md b/docs/_posts/ahmedlone127/2024-08-20-xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en.md new file mode 100644 index 00000000000000..5096ef35f28650 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4 T5Transformer from KingKazma +author: John Snow Labs +name: xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en_5.4.2_3.0_1724198182732.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_en_5.4.2_3.0_1724198182732.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.2 MB| + +## References + +https://huggingface.co/KingKazma/xsum_t5-small_fine_tuning_500_4_50000_8_e-1_s6789_v4_l4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en.md new file mode 100644 index 00000000000000..a2ce8528a09f43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline pipeline T5Transformer from KingKazma +author: John Snow Labs +name: xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline` is a English model originally trained by KingKazma. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en_5.4.2_3.0_1724198200652.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline_en_5.4.2_3.0_1724198200652.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_t5_small_fine_tuning_500_4_50000_8_e_1_s6789_v4_l4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.2 MB| + +## References + +https://huggingface.co/KingKazma/xsum_t5-small_fine_tuning_500_4_50000_8_e-1_s6789_v4_l4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_base_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_base_seed_3_en.md new file mode 100644 index 00000000000000..46bbf43d994e10 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_base_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English yelp_polarity_t5_base_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: yelp_polarity_t5_base_seed_3 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`yelp_polarity_t5_base_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_base_seed_3_en_5.4.2_3.0_1724176529528.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_base_seed_3_en_5.4.2_3.0_1724176529528.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("yelp_polarity_t5_base_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("yelp_polarity_t5_base_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|yelp_polarity_t5_base_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|998.4 MB| + +## References + +https://huggingface.co/utahnlp/yelp_polarity_t5-base_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_base_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_base_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..d681639cb1ad3a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_base_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English yelp_polarity_t5_base_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: yelp_polarity_t5_base_seed_3_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`yelp_polarity_t5_base_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724176582020.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724176582020.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("yelp_polarity_t5_base_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("yelp_polarity_t5_base_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|yelp_polarity_t5_base_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|998.4 MB| + +## References + +https://huggingface.co/utahnlp/yelp_polarity_t5-base_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_large_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_large_seed_2_en.md new file mode 100644 index 00000000000000..870541d9721e9a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_large_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English yelp_polarity_t5_large_seed_2 T5Transformer from utahnlp +author: John Snow Labs +name: yelp_polarity_t5_large_seed_2 +date: 2024-08-20 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`yelp_polarity_t5_large_seed_2` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_large_seed_2_en_5.4.2_3.0_1724154219797.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_large_seed_2_en_5.4.2_3.0_1724154219797.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("yelp_polarity_t5_large_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("yelp_polarity_t5_large_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|yelp_polarity_t5_large_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/utahnlp/yelp_polarity_t5-large_seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_large_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_large_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..9370e945fbe4b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-20-yelp_polarity_t5_large_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English yelp_polarity_t5_large_seed_2_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: yelp_polarity_t5_large_seed_2_pipeline +date: 2024-08-20 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`yelp_polarity_t5_large_seed_2_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_large_seed_2_pipeline_en_5.4.2_3.0_1724154362970.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_large_seed_2_pipeline_en_5.4.2_3.0_1724154362970.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("yelp_polarity_t5_large_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("yelp_polarity_t5_large_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|yelp_polarity_t5_large_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/utahnlp/yelp_polarity_t5-large_seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-20231130_2_en.md b/docs/_posts/ahmedlone127/2024-08-21-20231130_2_en.md new file mode 100644 index 00000000000000..259757f05601fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-20231130_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20231130_2 T5Transformer from picas9dan +author: John Snow Labs +name: 20231130_2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_2` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_2_en_5.4.2_3.0_1724257443261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_2_en_5.4.2_3.0_1724257443261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20231130_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20231130_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20231130_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20231130_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ada_t5_base_mysticmizzle_en.md b/docs/_posts/ahmedlone127/2024-08-21-ada_t5_base_mysticmizzle_en.md new file mode 100644 index 00000000000000..fe92aaf653198b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ada_t5_base_mysticmizzle_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ada_t5_base_mysticmizzle T5Transformer from MysticMizzle +author: John Snow Labs +name: ada_t5_base_mysticmizzle +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ada_t5_base_mysticmizzle` is a English model originally trained by MysticMizzle. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ada_t5_base_mysticmizzle_en_5.4.2_3.0_1724251879990.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ada_t5_base_mysticmizzle_en_5.4.2_3.0_1724251879990.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ada_t5_base_mysticmizzle","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ada_t5_base_mysticmizzle", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ada_t5_base_mysticmizzle| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|969.7 MB| + +## References + +https://huggingface.co/MysticMizzle/ada-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ada_t5_base_mysticmizzle_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-ada_t5_base_mysticmizzle_pipeline_en.md new file mode 100644 index 00000000000000..38b321547420b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ada_t5_base_mysticmizzle_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ada_t5_base_mysticmizzle_pipeline pipeline T5Transformer from MysticMizzle +author: John Snow Labs +name: ada_t5_base_mysticmizzle_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ada_t5_base_mysticmizzle_pipeline` is a English model originally trained by MysticMizzle. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ada_t5_base_mysticmizzle_pipeline_en_5.4.2_3.0_1724251934013.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ada_t5_base_mysticmizzle_pipeline_en_5.4.2_3.0_1724251934013.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ada_t5_base_mysticmizzle_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ada_t5_base_mysticmizzle_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ada_t5_base_mysticmizzle_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|969.7 MB| + +## References + +https://huggingface.co/MysticMizzle/ada-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-adaptive_rag_classifier_en.md b/docs/_posts/ahmedlone127/2024-08-21-adaptive_rag_classifier_en.md new file mode 100644 index 00000000000000..25ed8c98f640ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-adaptive_rag_classifier_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English adaptive_rag_classifier T5Transformer from illuminoplanet +author: John Snow Labs +name: adaptive_rag_classifier +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`adaptive_rag_classifier` is a English model originally trained by illuminoplanet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/adaptive_rag_classifier_en_5.4.2_3.0_1724221513061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/adaptive_rag_classifier_en_5.4.2_3.0_1724221513061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("adaptive_rag_classifier","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("adaptive_rag_classifier", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|adaptive_rag_classifier| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/illuminoplanet/adaptive-rag-classifier \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-adaptive_rag_classifier_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-adaptive_rag_classifier_pipeline_en.md new file mode 100644 index 00000000000000..e591da2295a509 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-adaptive_rag_classifier_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English adaptive_rag_classifier_pipeline pipeline T5Transformer from illuminoplanet +author: John Snow Labs +name: adaptive_rag_classifier_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`adaptive_rag_classifier_pipeline` is a English model originally trained by illuminoplanet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/adaptive_rag_classifier_pipeline_en_5.4.2_3.0_1724221674709.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/adaptive_rag_classifier_pipeline_en_5.4.2_3.0_1724221674709.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("adaptive_rag_classifier_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("adaptive_rag_classifier_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|adaptive_rag_classifier_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/illuminoplanet/adaptive-rag-classifier + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-afrimt5_english_yor_news_en.md b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_english_yor_news_en.md new file mode 100644 index 00000000000000..57ccbefb26f663 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_english_yor_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English afrimt5_english_yor_news T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_english_yor_news +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_english_yor_news` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_english_yor_news_en_5.4.2_3.0_1724224692524.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_english_yor_news_en_5.4.2_3.0_1724224692524.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("afrimt5_english_yor_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("afrimt5_english_yor_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_english_yor_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_en_yor_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-afrimt5_english_yor_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_english_yor_news_pipeline_en.md new file mode 100644 index 00000000000000..56e8c647fe8944 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_english_yor_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English afrimt5_english_yor_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_english_yor_news_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_english_yor_news_pipeline` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_english_yor_news_pipeline_en_5.4.2_3.0_1724224835053.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_english_yor_news_pipeline_en_5.4.2_3.0_1724224835053.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("afrimt5_english_yor_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("afrimt5_english_yor_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_english_yor_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_en_yor_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-afrimt5_fon_french_news_fr.md b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_fon_french_news_fr.md new file mode 100644 index 00000000000000..56138ee0aa9d6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_fon_french_news_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French afrimt5_fon_french_news T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_fon_french_news +date: 2024-08-21 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_fon_french_news` is a French model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_fon_french_news_fr_5.4.2_3.0_1724260894918.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_fon_french_news_fr_5.4.2_3.0_1724260894918.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("afrimt5_fon_french_news","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("afrimt5_fon_french_news", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_fon_french_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_fon_fr_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-afrimt5_fon_french_news_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_fon_french_news_pipeline_fr.md new file mode 100644 index 00000000000000..c167d83628530f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_fon_french_news_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French afrimt5_fon_french_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_fon_french_news_pipeline +date: 2024-08-21 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_fon_french_news_pipeline` is a French model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_fon_french_news_pipeline_fr_5.4.2_3.0_1724261032240.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_fon_french_news_pipeline_fr_5.4.2_3.0_1724261032240.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("afrimt5_fon_french_news_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("afrimt5_fon_french_news_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_fon_french_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_fon_fr_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-afrimt5_swahili_macrolanguage_english_news_en.md b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_swahili_macrolanguage_english_news_en.md new file mode 100644 index 00000000000000..be482f1e453c24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_swahili_macrolanguage_english_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English afrimt5_swahili_macrolanguage_english_news T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_swahili_macrolanguage_english_news +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_swahili_macrolanguage_english_news` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_swahili_macrolanguage_english_news_en_5.4.2_3.0_1724268787047.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_swahili_macrolanguage_english_news_en_5.4.2_3.0_1724268787047.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("afrimt5_swahili_macrolanguage_english_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("afrimt5_swahili_macrolanguage_english_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_swahili_macrolanguage_english_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_swa_en_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-afrimt5_swahili_macrolanguage_english_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_swahili_macrolanguage_english_news_pipeline_en.md new file mode 100644 index 00000000000000..14b3c04d73260c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-afrimt5_swahili_macrolanguage_english_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English afrimt5_swahili_macrolanguage_english_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: afrimt5_swahili_macrolanguage_english_news_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrimt5_swahili_macrolanguage_english_news_pipeline` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrimt5_swahili_macrolanguage_english_news_pipeline_en_5.4.2_3.0_1724268930918.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrimt5_swahili_macrolanguage_english_news_pipeline_en_5.4.2_3.0_1724268930918.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("afrimt5_swahili_macrolanguage_english_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("afrimt5_swahili_macrolanguage_english_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrimt5_swahili_macrolanguage_english_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/masakhane/afrimt5_swa_en_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-afriteva_v2_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-afriteva_v2_base_en.md new file mode 100644 index 00000000000000..6b57ad0c2d8984 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-afriteva_v2_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English afriteva_v2_base T5Transformer from castorini +author: John Snow Labs +name: afriteva_v2_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afriteva_v2_base` is a English model originally trained by castorini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afriteva_v2_base_en_5.4.2_3.0_1724215494307.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afriteva_v2_base_en_5.4.2_3.0_1724215494307.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("afriteva_v2_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("afriteva_v2_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afriteva_v2_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.0 GB| + +## References + +https://huggingface.co/castorini/afriteva_v2_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-afriteva_v2_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-afriteva_v2_base_pipeline_en.md new file mode 100644 index 00000000000000..046a8c939357b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-afriteva_v2_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English afriteva_v2_base_pipeline pipeline T5Transformer from castorini +author: John Snow Labs +name: afriteva_v2_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afriteva_v2_base_pipeline` is a English model originally trained by castorini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afriteva_v2_base_pipeline_en_5.4.2_3.0_1724215590699.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afriteva_v2_base_pipeline_en_5.4.2_3.0_1724215590699.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("afriteva_v2_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("afriteva_v2_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afriteva_v2_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.0 GB| + +## References + +https://huggingface.co/castorini/afriteva_v2_base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ag_news_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-21-ag_news_t5_large_en.md new file mode 100644 index 00000000000000..5428fb41e51994 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ag_news_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ag_news_t5_large T5Transformer from Kyle1668 +author: John Snow Labs +name: ag_news_t5_large +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ag_news_t5_large` is a English model originally trained by Kyle1668. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ag_news_t5_large_en_5.4.2_3.0_1724279055368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ag_news_t5_large_en_5.4.2_3.0_1724279055368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ag_news_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ag_news_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ag_news_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Kyle1668/ag-news-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ag_news_t5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-ag_news_t5_large_pipeline_en.md new file mode 100644 index 00000000000000..5aae013c28bd37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ag_news_t5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ag_news_t5_large_pipeline pipeline T5Transformer from Kyle1668 +author: John Snow Labs +name: ag_news_t5_large_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ag_news_t5_large_pipeline` is a English model originally trained by Kyle1668. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ag_news_t5_large_pipeline_en_5.4.2_3.0_1724279185455.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ag_news_t5_large_pipeline_en_5.4.2_3.0_1724279185455.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ag_news_t5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ag_news_t5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ag_news_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Kyle1668/ag-news-t5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-algebra_linear_1d_dbernsohn_en.md b/docs/_posts/ahmedlone127/2024-08-21-algebra_linear_1d_dbernsohn_en.md new file mode 100644 index 00000000000000..db274c642245f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-algebra_linear_1d_dbernsohn_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English algebra_linear_1d_dbernsohn T5Transformer from dbernsohn +author: John Snow Labs +name: algebra_linear_1d_dbernsohn +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`algebra_linear_1d_dbernsohn` is a English model originally trained by dbernsohn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/algebra_linear_1d_dbernsohn_en_5.4.2_3.0_1724260357292.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/algebra_linear_1d_dbernsohn_en_5.4.2_3.0_1724260357292.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("algebra_linear_1d_dbernsohn","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("algebra_linear_1d_dbernsohn", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|algebra_linear_1d_dbernsohn| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.1 MB| + +## References + +https://huggingface.co/dbernsohn/algebra_linear_1d \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-algebra_linear_1d_dbernsohn_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-algebra_linear_1d_dbernsohn_pipeline_en.md new file mode 100644 index 00000000000000..6f1bdcc7079493 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-algebra_linear_1d_dbernsohn_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English algebra_linear_1d_dbernsohn_pipeline pipeline T5Transformer from dbernsohn +author: John Snow Labs +name: algebra_linear_1d_dbernsohn_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`algebra_linear_1d_dbernsohn_pipeline` is a English model originally trained by dbernsohn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/algebra_linear_1d_dbernsohn_pipeline_en_5.4.2_3.0_1724260380897.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/algebra_linear_1d_dbernsohn_pipeline_en_5.4.2_3.0_1724260380897.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("algebra_linear_1d_dbernsohn_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("algebra_linear_1d_dbernsohn_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|algebra_linear_1d_dbernsohn_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.1 MB| + +## References + +https://huggingface.co/dbernsohn/algebra_linear_1d + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_en.md b/docs/_posts/ahmedlone127/2024-08-21-all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_en.md new file mode 100644 index 00000000000000..375cbaa5b42205 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch T5Transformer from e22vvb +author: John Snow Labs +name: all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_en_5.4.2_3.0_1724209230442.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_en_5.4.2_3.0_1724209230442.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_manual_mt5-base_15_spider_no_sch_15_wikiSQL_no_sch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline_en.md new file mode 100644 index 00000000000000..42a8100a45a0df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline_en_5.4.2_3.0_1724209497463.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline_en_5.4.2_3.0_1724209497463.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_manual_mt5_base_15_spider_norwegian_sch_15_wikisql_norwegian_sch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_manual_mt5-base_15_spider_no_sch_15_wikiSQL_no_sch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-arabict5_large_arabic_english_nan.md b/docs/_posts/ahmedlone127/2024-08-21-arabict5_large_arabic_english_nan.md new file mode 100644 index 00000000000000..b2d8b08f3efb2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-arabict5_large_arabic_english_nan.md @@ -0,0 +1,86 @@ +--- +layout: model +title: None arabict5_large_arabic_english T5Transformer from sultan +author: John Snow Labs +name: arabict5_large_arabic_english +date: 2024-08-21 +tags: [nan, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nan +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arabict5_large_arabic_english` is a None model originally trained by sultan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arabict5_large_arabic_english_nan_5.4.2_3.0_1724237335832.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arabict5_large_arabic_english_nan_5.4.2_3.0_1724237335832.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arabict5_large_arabic_english","nan") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arabict5_large_arabic_english", "nan") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arabict5_large_arabic_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|nan| +|Size:|1.3 GB| + +## References + +https://huggingface.co/sultan/ArabicT5-Large_Ar-En \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-arabict5_large_arabic_english_pipeline_nan.md b/docs/_posts/ahmedlone127/2024-08-21-arabict5_large_arabic_english_pipeline_nan.md new file mode 100644 index 00000000000000..b71349887a783b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-arabict5_large_arabic_english_pipeline_nan.md @@ -0,0 +1,69 @@ +--- +layout: model +title: None arabict5_large_arabic_english_pipeline pipeline T5Transformer from sultan +author: John Snow Labs +name: arabict5_large_arabic_english_pipeline +date: 2024-08-21 +tags: [nan, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nan +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arabict5_large_arabic_english_pipeline` is a None model originally trained by sultan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arabict5_large_arabic_english_pipeline_nan_5.4.2_3.0_1724237412023.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arabict5_large_arabic_english_pipeline_nan_5.4.2_3.0_1724237412023.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arabict5_large_arabic_english_pipeline", lang = "nan") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arabict5_large_arabic_english_pipeline", lang = "nan") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arabict5_large_arabic_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|nan| +|Size:|1.3 GB| + +## References + +https://huggingface.co/sultan/ArabicT5-Large_Ar-En + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-arat5_southern_sotho_qg_mlqa_arabic_en.md b/docs/_posts/ahmedlone127/2024-08-21-arat5_southern_sotho_qg_mlqa_arabic_en.md new file mode 100644 index 00000000000000..2e7b3de2d73e0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-arat5_southern_sotho_qg_mlqa_arabic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arat5_southern_sotho_qg_mlqa_arabic T5Transformer from sidovic +author: John Snow Labs +name: arat5_southern_sotho_qg_mlqa_arabic +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_southern_sotho_qg_mlqa_arabic` is a English model originally trained by sidovic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_southern_sotho_qg_mlqa_arabic_en_5.4.2_3.0_1724210081866.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_southern_sotho_qg_mlqa_arabic_en_5.4.2_3.0_1724210081866.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arat5_southern_sotho_qg_mlqa_arabic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arat5_southern_sotho_qg_mlqa_arabic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_southern_sotho_qg_mlqa_arabic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/sidovic/AraT5-ST-qg-mlqa-arabic \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-arat5_southern_sotho_qg_mlqa_arabic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-arat5_southern_sotho_qg_mlqa_arabic_pipeline_en.md new file mode 100644 index 00000000000000..f44a1d0d5d1840 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-arat5_southern_sotho_qg_mlqa_arabic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arat5_southern_sotho_qg_mlqa_arabic_pipeline pipeline T5Transformer from sidovic +author: John Snow Labs +name: arat5_southern_sotho_qg_mlqa_arabic_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_southern_sotho_qg_mlqa_arabic_pipeline` is a English model originally trained by sidovic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_southern_sotho_qg_mlqa_arabic_pipeline_en_5.4.2_3.0_1724210164145.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_southern_sotho_qg_mlqa_arabic_pipeline_en_5.4.2_3.0_1724210164145.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arat5_southern_sotho_qg_mlqa_arabic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arat5_southern_sotho_qg_mlqa_arabic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_southern_sotho_qg_mlqa_arabic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/sidovic/AraT5-ST-qg-mlqa-arabic + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-assignment2_attempt1_en.md b/docs/_posts/ahmedlone127/2024-08-21-assignment2_attempt1_en.md new file mode 100644 index 00000000000000..513c1c59115d81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-assignment2_attempt1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English assignment2_attempt1 T5Transformer from mpalaval +author: John Snow Labs +name: assignment2_attempt1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`assignment2_attempt1` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/assignment2_attempt1_en_5.4.2_3.0_1724269980303.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/assignment2_attempt1_en_5.4.2_3.0_1724269980303.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("assignment2_attempt1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("assignment2_attempt1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|assignment2_attempt1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|784.0 MB| + +## References + +https://huggingface.co/mpalaval/assignment2_attempt1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-assignment2_attempt1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-assignment2_attempt1_pipeline_en.md new file mode 100644 index 00000000000000..42182ff1f905af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-assignment2_attempt1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English assignment2_attempt1_pipeline pipeline T5Transformer from mpalaval +author: John Snow Labs +name: assignment2_attempt1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`assignment2_attempt1_pipeline` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/assignment2_attempt1_pipeline_en_5.4.2_3.0_1724270070264.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/assignment2_attempt1_pipeline_en_5.4.2_3.0_1724270070264.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("assignment2_attempt1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("assignment2_attempt1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|assignment2_attempt1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|784.0 MB| + +## References + +https://huggingface.co/mpalaval/assignment2_attempt1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en.md b/docs/_posts/ahmedlone127/2024-08-21-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en.md new file mode 100644 index 00000000000000..ee1560308dbaf7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants T5Transformer from kevinscaria +author: John Snow Labs +name: ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en_5.4.2_3.0_1724262624789.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_en_5.4.2_3.0_1724262624789.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|947.2 MB| + +## References + +https://huggingface.co/kevinscaria/ate_tk-instruct-base-def-pos-neg-neut-restaurants \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en.md new file mode 100644 index 00000000000000..68be7d1d8ba06c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline pipeline T5Transformer from kevinscaria +author: John Snow Labs +name: ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en_5.4.2_3.0_1724262676697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline_en_5.4.2_3.0_1724262676697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ate_turkmen_instruct_base_def_sayula_popoluca_neg_neut_restaurants_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|947.2 MB| + +## References + +https://huggingface.co/kevinscaria/ate_tk-instruct-base-def-pos-neg-neut-restaurants + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en.md b/docs/_posts/ahmedlone127/2024-08-21-atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en.md new file mode 100644 index 00000000000000..a2e7b58bcc57e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops T5Transformer from kevinscaria +author: John Snow Labs +name: atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en_5.4.2_3.0_1724271935215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_en_5.4.2_3.0_1724271935215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|932.5 MB| + +## References + +https://huggingface.co/kevinscaria/atsc_tk-instruct-base-def-pos-neg-neut-laptops \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en.md new file mode 100644 index 00000000000000..7a8e1cd0d0d654 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline pipeline T5Transformer from kevinscaria +author: John Snow Labs +name: atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en_5.4.2_3.0_1724271986353.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline_en_5.4.2_3.0_1724271986353.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|atsc_turkmen_instruct_base_def_sayula_popoluca_neg_neut_laptops_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|932.5 MB| + +## References + +https://huggingface.co/kevinscaria/atsc_tk-instruct-base-def-pos-neg-neut-laptops + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-21-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en.md new file mode 100644 index 00000000000000..a3b8cde7cfab17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en_5.4.2_3.0_1724210289769.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_en_5.4.2_3.0_1724210289769.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.9 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_shuffled_graphs_without_edge_document_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..f4ad6ffaaf9a89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724210307949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724210307949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_shuffled_graphs_without_edge_document_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.9 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_shuffled_graphs_without_edge_document_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-banglat5_finetuned_headlinebt5_1000_withip_normal_en.md b/docs/_posts/ahmedlone127/2024-08-21-banglat5_finetuned_headlinebt5_1000_withip_normal_en.md new file mode 100644 index 00000000000000..9716f90c32a44f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-banglat5_finetuned_headlinebt5_1000_withip_normal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English banglat5_finetuned_headlinebt5_1000_withip_normal T5Transformer from mdosama39 +author: John Snow Labs +name: banglat5_finetuned_headlinebt5_1000_withip_normal +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_finetuned_headlinebt5_1000_withip_normal` is a English model originally trained by mdosama39. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_finetuned_headlinebt5_1000_withip_normal_en_5.4.2_3.0_1724245505224.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_finetuned_headlinebt5_1000_withip_normal_en_5.4.2_3.0_1724245505224.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("banglat5_finetuned_headlinebt5_1000_withip_normal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("banglat5_finetuned_headlinebt5_1000_withip_normal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_finetuned_headlinebt5_1000_withip_normal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|966.0 MB| + +## References + +https://huggingface.co/mdosama39/banglat5-finetuned-headlineBT5_1000_WithIp_Normal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline_en.md new file mode 100644 index 00000000000000..bfc6e14d51d3af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline pipeline T5Transformer from mdosama39 +author: John Snow Labs +name: banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline` is a English model originally trained by mdosama39. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline_en_5.4.2_3.0_1724245563910.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline_en_5.4.2_3.0_1724245563910.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|banglat5_finetuned_headlinebt5_1000_withip_normal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|966.0 MB| + +## References + +https://huggingface.co/mdosama39/banglat5-finetuned-headlineBT5_1000_WithIp_Normal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-biot5_plus_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-biot5_plus_base_en.md new file mode 100644 index 00000000000000..a8aba458c6b5e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-biot5_plus_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English biot5_plus_base T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_plus_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_plus_base` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_plus_base_en_5.4.2_3.0_1724216951369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_plus_base_en_5.4.2_3.0_1724216951369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("biot5_plus_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("biot5_plus_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_plus_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-plus-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-biot5_plus_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-biot5_plus_base_pipeline_en.md new file mode 100644 index 00000000000000..7ed00348915058 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-biot5_plus_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English biot5_plus_base_pipeline pipeline T5Transformer from QizhiPei +author: John Snow Labs +name: biot5_plus_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`biot5_plus_base_pipeline` is a English model originally trained by QizhiPei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/biot5_plus_base_pipeline_en_5.4.2_3.0_1724217001035.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/biot5_plus_base_pipeline_en_5.4.2_3.0_1724217001035.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("biot5_plus_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("biot5_plus_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|biot5_plus_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/QizhiPei/biot5-plus-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_floriancaro_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_floriancaro_en.md new file mode 100644 index 00000000000000..62907dafaaeaa8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_floriancaro_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_floriancaro T5Transformer from floriancaro +author: John Snow Labs +name: burmese_awesome_billsum_model_floriancaro +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_floriancaro` is a English model originally trained by floriancaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_floriancaro_en_5.4.2_3.0_1724270529288.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_floriancaro_en_5.4.2_3.0_1724270529288.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_floriancaro","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_floriancaro", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_floriancaro| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.1 MB| + +## References + +https://huggingface.co/floriancaro/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_floriancaro_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_floriancaro_pipeline_en.md new file mode 100644 index 00000000000000..619ca53aa3283b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_floriancaro_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_floriancaro_pipeline pipeline T5Transformer from floriancaro +author: John Snow Labs +name: burmese_awesome_billsum_model_floriancaro_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_floriancaro_pipeline` is a English model originally trained by floriancaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_floriancaro_pipeline_en_5.4.2_3.0_1724270549723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_floriancaro_pipeline_en_5.4.2_3.0_1724270549723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_floriancaro_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_floriancaro_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_floriancaro_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.1 MB| + +## References + +https://huggingface.co/floriancaro/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_hftest2242_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_hftest2242_en.md new file mode 100644 index 00000000000000..6cc3caa0917f05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_hftest2242_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_hftest2242 T5Transformer from hftest2242 +author: John Snow Labs +name: burmese_awesome_billsum_model_hftest2242 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_hftest2242` is a English model originally trained by hftest2242. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_hftest2242_en_5.4.2_3.0_1724282201062.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_hftest2242_en_5.4.2_3.0_1724282201062.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_hftest2242","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_hftest2242", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_hftest2242| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|322.9 MB| + +## References + +https://huggingface.co/hftest2242/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_hftest2242_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_hftest2242_pipeline_en.md new file mode 100644 index 00000000000000..bc01ce3cde31d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_hftest2242_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_hftest2242_pipeline pipeline T5Transformer from hftest2242 +author: John Snow Labs +name: burmese_awesome_billsum_model_hftest2242_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_hftest2242_pipeline` is a English model originally trained by hftest2242. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_hftest2242_pipeline_en_5.4.2_3.0_1724282222887.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_hftest2242_pipeline_en_5.4.2_3.0_1724282222887.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_hftest2242_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_hftest2242_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_hftest2242_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|322.9 MB| + +## References + +https://huggingface.co/hftest2242/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_quinta6728_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_quinta6728_en.md new file mode 100644 index 00000000000000..ac1f2e9894ccee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_quinta6728_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_quinta6728 T5Transformer from Quinta6728 +author: John Snow Labs +name: burmese_awesome_billsum_model_quinta6728 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_quinta6728` is a English model originally trained by Quinta6728. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_quinta6728_en_5.4.2_3.0_1724276123261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_quinta6728_en_5.4.2_3.0_1724276123261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_quinta6728","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_quinta6728", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_quinta6728| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.4 MB| + +## References + +https://huggingface.co/Quinta6728/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_quinta6728_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_quinta6728_pipeline_en.md new file mode 100644 index 00000000000000..5857d1008c739f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_quinta6728_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_quinta6728_pipeline pipeline T5Transformer from Quinta6728 +author: John Snow Labs +name: burmese_awesome_billsum_model_quinta6728_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_quinta6728_pipeline` is a English model originally trained by Quinta6728. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_quinta6728_pipeline_en_5.4.2_3.0_1724276146337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_quinta6728_pipeline_en_5.4.2_3.0_1724276146337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_quinta6728_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_quinta6728_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_quinta6728_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.4 MB| + +## References + +https://huggingface.co/Quinta6728/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_tuminibd29_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_tuminibd29_en.md new file mode 100644 index 00000000000000..b50576766283bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_tuminibd29_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_tuminibd29 T5Transformer from tuminibd29 +author: John Snow Labs +name: burmese_awesome_billsum_model_tuminibd29 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_tuminibd29` is a English model originally trained by tuminibd29. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_tuminibd29_en_5.4.2_3.0_1724235482219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_tuminibd29_en_5.4.2_3.0_1724235482219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_tuminibd29","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_tuminibd29", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_tuminibd29| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.5 MB| + +## References + +https://huggingface.co/tuminibd29/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_tuminibd29_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_tuminibd29_pipeline_en.md new file mode 100644 index 00000000000000..1e35048b7e0f75 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_billsum_model_tuminibd29_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_tuminibd29_pipeline pipeline T5Transformer from tuminibd29 +author: John Snow Labs +name: burmese_awesome_billsum_model_tuminibd29_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_tuminibd29_pipeline` is a English model originally trained by tuminibd29. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_tuminibd29_pipeline_en_5.4.2_3.0_1724235499624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_tuminibd29_pipeline_en_5.4.2_3.0_1724235499624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_tuminibd29_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_tuminibd29_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_tuminibd29_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.5 MB| + +## References + +https://huggingface.co/tuminibd29/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_model_rohitdileep_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_model_rohitdileep_en.md new file mode 100644 index 00000000000000..44d412a9255788 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_model_rohitdileep_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_model_rohitdileep T5Transformer from Rohitdileep +author: John Snow Labs +name: burmese_awesome_model_rohitdileep +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_model_rohitdileep` is a English model originally trained by Rohitdileep. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_rohitdileep_en_5.4.2_3.0_1724237016723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_rohitdileep_en_5.4.2_3.0_1724237016723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_model_rohitdileep","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_model_rohitdileep", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_model_rohitdileep| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.7 MB| + +## References + +https://huggingface.co/Rohitdileep/my_awesome_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_model_rohitdileep_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_model_rohitdileep_pipeline_en.md new file mode 100644 index 00000000000000..be12df1a7e9ec5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_model_rohitdileep_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_model_rohitdileep_pipeline pipeline T5Transformer from Rohitdileep +author: John Snow Labs +name: burmese_awesome_model_rohitdileep_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_model_rohitdileep_pipeline` is a English model originally trained by Rohitdileep. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_rohitdileep_pipeline_en_5.4.2_3.0_1724237043694.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_rohitdileep_pipeline_en_5.4.2_3.0_1724237043694.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_model_rohitdileep_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_model_rohitdileep_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_model_rohitdileep_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.7 MB| + +## References + +https://huggingface.co/Rohitdileep/my_awesome_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_irodrigues_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_irodrigues_en.md new file mode 100644 index 00000000000000..6acc1bd7601413 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_irodrigues_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_irodrigues T5Transformer from irodrigues +author: John Snow Labs +name: burmese_awesome_opus_books_model_irodrigues +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_irodrigues` is a English model originally trained by irodrigues. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_irodrigues_en_5.4.2_3.0_1724234798188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_irodrigues_en_5.4.2_3.0_1724234798188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_irodrigues","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_irodrigues", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_irodrigues| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/irodrigues/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_irodrigues_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_irodrigues_pipeline_en.md new file mode 100644 index 00000000000000..e32737afbe455f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_irodrigues_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_irodrigues_pipeline pipeline T5Transformer from irodrigues +author: John Snow Labs +name: burmese_awesome_opus_books_model_irodrigues_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_irodrigues_pipeline` is a English model originally trained by irodrigues. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_irodrigues_pipeline_en_5.4.2_3.0_1724234815355.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_irodrigues_pipeline_en_5.4.2_3.0_1724234815355.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_irodrigues_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_irodrigues_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_irodrigues_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/irodrigues/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_pavi156_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_pavi156_en.md new file mode 100644 index 00000000000000..7b9225b1d1150b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_pavi156_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_pavi156 T5Transformer from pavi156 +author: John Snow Labs +name: burmese_awesome_opus_books_model_pavi156 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_pavi156` is a English model originally trained by pavi156. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_pavi156_en_5.4.2_3.0_1724199481308.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_pavi156_en_5.4.2_3.0_1724199481308.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_pavi156","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_pavi156", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_pavi156| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/pavi156/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_pavi156_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_pavi156_pipeline_en.md new file mode 100644 index 00000000000000..24a1bdfe71c587 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_opus_books_model_pavi156_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_pavi156_pipeline pipeline T5Transformer from pavi156 +author: John Snow Labs +name: burmese_awesome_opus_books_model_pavi156_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_pavi156_pipeline` is a English model originally trained by pavi156. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_pavi156_pipeline_en_5.4.2_3.0_1724199499734.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_pavi156_pipeline_en_5.4.2_3.0_1724199499734.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_pavi156_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_pavi156_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_pavi156_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/pavi156/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_t5_model_shen77_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_t5_model_shen77_en.md new file mode 100644 index 00000000000000..a07ca3405d8a45 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_t5_model_shen77_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_t5_model_shen77 T5Transformer from shen77 +author: John Snow Labs +name: burmese_awesome_t5_model_shen77 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_t5_model_shen77` is a English model originally trained by shen77. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_t5_model_shen77_en_5.4.2_3.0_1724241440189.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_t5_model_shen77_en_5.4.2_3.0_1724241440189.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_t5_model_shen77","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_t5_model_shen77", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_t5_model_shen77| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.3 MB| + +## References + +https://huggingface.co/shen77/my_awesome_t5_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_t5_model_shen77_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_t5_model_shen77_pipeline_en.md new file mode 100644 index 00000000000000..9bd35cc5af0f75 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_awesome_t5_model_shen77_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_t5_model_shen77_pipeline pipeline T5Transformer from shen77 +author: John Snow Labs +name: burmese_awesome_t5_model_shen77_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_t5_model_shen77_pipeline` is a English model originally trained by shen77. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_t5_model_shen77_pipeline_en_5.4.2_3.0_1724241458843.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_t5_model_shen77_pipeline_en_5.4.2_3.0_1724241458843.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_t5_model_shen77_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_t5_model_shen77_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_t5_model_shen77_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.3 MB| + +## References + +https://huggingface.co/shen77/my_awesome_t5_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_lenta_model_russian_mt5_base_4_epochs_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_lenta_model_russian_mt5_base_4_epochs_pipeline_ru.md new file mode 100644 index 00000000000000..5dc6fb9321b2f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_lenta_model_russian_mt5_base_4_epochs_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian burmese_lenta_model_russian_mt5_base_4_epochs_pipeline pipeline T5Transformer from i-k-a +author: John Snow Labs +name: burmese_lenta_model_russian_mt5_base_4_epochs_pipeline +date: 2024-08-21 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_lenta_model_russian_mt5_base_4_epochs_pipeline` is a Russian model originally trained by i-k-a. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_lenta_model_russian_mt5_base_4_epochs_pipeline_ru_5.4.2_3.0_1724266808635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_lenta_model_russian_mt5_base_4_epochs_pipeline_ru_5.4.2_3.0_1724266808635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_lenta_model_russian_mt5_base_4_epochs_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_lenta_model_russian_mt5_base_4_epochs_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_lenta_model_russian_mt5_base_4_epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|2.3 GB| + +## References + +https://huggingface.co/i-k-a/my_lenta_model_ru_mt5-base_4_epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_lenta_model_russian_mt5_base_4_epochs_ru.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_lenta_model_russian_mt5_base_4_epochs_ru.md new file mode 100644 index 00000000000000..b1c9e60d91e009 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_lenta_model_russian_mt5_base_4_epochs_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian burmese_lenta_model_russian_mt5_base_4_epochs T5Transformer from i-k-a +author: John Snow Labs +name: burmese_lenta_model_russian_mt5_base_4_epochs +date: 2024-08-21 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_lenta_model_russian_mt5_base_4_epochs` is a Russian model originally trained by i-k-a. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_lenta_model_russian_mt5_base_4_epochs_ru_5.4.2_3.0_1724266566772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_lenta_model_russian_mt5_base_4_epochs_ru_5.4.2_3.0_1724266566772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_lenta_model_russian_mt5_base_4_epochs","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_lenta_model_russian_mt5_base_4_epochs", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_lenta_model_russian_mt5_base_4_epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|2.3 GB| + +## References + +https://huggingface.co/i-k-a/my_lenta_model_ru_mt5-base_4_epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_model_2_sheoran95_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_model_2_sheoran95_en.md new file mode 100644 index 00000000000000..afd9e6a952ea24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_model_2_sheoran95_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_model_2_sheoran95 T5Transformer from sheoran95 +author: John Snow Labs +name: burmese_model_2_sheoran95 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_model_2_sheoran95` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_model_2_sheoran95_en_5.4.2_3.0_1724243756429.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_model_2_sheoran95_en_5.4.2_3.0_1724243756429.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_model_2_sheoran95","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_model_2_sheoran95", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_model_2_sheoran95| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.6 MB| + +## References + +https://huggingface.co/sheoran95/my_model_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-burmese_model_2_sheoran95_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-burmese_model_2_sheoran95_pipeline_en.md new file mode 100644 index 00000000000000..8af8002a5b00e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-burmese_model_2_sheoran95_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_model_2_sheoran95_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: burmese_model_2_sheoran95_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_model_2_sheoran95_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_model_2_sheoran95_pipeline_en_5.4.2_3.0_1724243775325.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_model_2_sheoran95_pipeline_en_5.4.2_3.0_1724243775325.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_model_2_sheoran95_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_model_2_sheoran95_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_model_2_sheoran95_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|325.6 MB| + +## References + +https://huggingface.co/sheoran95/my_model_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-calm_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-calm_base_en.md new file mode 100644 index 00000000000000..63eef385518b4e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-calm_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English calm_base T5Transformer from danny911kr +author: John Snow Labs +name: calm_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`calm_base` is a English model originally trained by danny911kr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/calm_base_en_5.4.2_3.0_1724256424003.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/calm_base_en_5.4.2_3.0_1724256424003.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("calm_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("calm_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|calm_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/danny911kr/calm-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-calm_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-calm_base_pipeline_en.md new file mode 100644 index 00000000000000..e3fc42e97d80b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-calm_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English calm_base_pipeline pipeline T5Transformer from danny911kr +author: John Snow Labs +name: calm_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`calm_base_pipeline` is a English model originally trained by danny911kr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/calm_base_pipeline_en_5.4.2_3.0_1724256476810.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/calm_base_pipeline_en_5.4.2_3.0_1724256476810.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("calm_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("calm_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|calm_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/danny911kr/calm-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-chatcare_rlhf_en.md b/docs/_posts/ahmedlone127/2024-08-21-chatcare_rlhf_en.md new file mode 100644 index 00000000000000..6dcbb55baa79a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-chatcare_rlhf_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English chatcare_rlhf T5Transformer from llllhd +author: John Snow Labs +name: chatcare_rlhf +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chatcare_rlhf` is a English model originally trained by llllhd. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chatcare_rlhf_en_5.4.2_3.0_1724199128174.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chatcare_rlhf_en_5.4.2_3.0_1724199128174.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("chatcare_rlhf","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("chatcare_rlhf", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chatcare_rlhf| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/llllhd/ChatCare-RLHF \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-chatcare_rlhf_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-chatcare_rlhf_pipeline_en.md new file mode 100644 index 00000000000000..ae67a4efe9c46c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-chatcare_rlhf_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English chatcare_rlhf_pipeline pipeline T5Transformer from llllhd +author: John Snow Labs +name: chatcare_rlhf_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chatcare_rlhf_pipeline` is a English model originally trained by llllhd. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chatcare_rlhf_pipeline_en_5.4.2_3.0_1724199287520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chatcare_rlhf_pipeline_en_5.4.2_3.0_1724199287520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("chatcare_rlhf_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("chatcare_rlhf_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chatcare_rlhf_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/llllhd/ChatCare-RLHF + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-chatgpt_paraphraser_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-21-chatgpt_paraphraser_t5_large_en.md new file mode 100644 index 00000000000000..3bc3dc80f441e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-chatgpt_paraphraser_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English chatgpt_paraphraser_t5_large T5Transformer from MichaelOrme +author: John Snow Labs +name: chatgpt_paraphraser_t5_large +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chatgpt_paraphraser_t5_large` is a English model originally trained by MichaelOrme. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chatgpt_paraphraser_t5_large_en_5.4.2_3.0_1724274109436.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chatgpt_paraphraser_t5_large_en_5.4.2_3.0_1724274109436.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("chatgpt_paraphraser_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("chatgpt_paraphraser_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chatgpt_paraphraser_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/MichaelOrme/ChatGPT_Paraphraser_t5-Large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-chatgpt_paraphraser_t5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-chatgpt_paraphraser_t5_large_pipeline_en.md new file mode 100644 index 00000000000000..27db08e6ef81fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-chatgpt_paraphraser_t5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English chatgpt_paraphraser_t5_large_pipeline pipeline T5Transformer from MichaelOrme +author: John Snow Labs +name: chatgpt_paraphraser_t5_large_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chatgpt_paraphraser_t5_large_pipeline` is a English model originally trained by MichaelOrme. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chatgpt_paraphraser_t5_large_pipeline_en_5.4.2_3.0_1724274241251.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chatgpt_paraphraser_t5_large_pipeline_en_5.4.2_3.0_1724274241251.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("chatgpt_paraphraser_t5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("chatgpt_paraphraser_t5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chatgpt_paraphraser_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/MichaelOrme/ChatGPT_Paraphraser_t5-Large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-chechen_en.md b/docs/_posts/ahmedlone127/2024-08-21-chechen_en.md new file mode 100644 index 00000000000000..d25d914a726937 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-chechen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English chechen T5Transformer from jiawei1998 +author: John Snow Labs +name: chechen +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chechen` is a English model originally trained by jiawei1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chechen_en_5.4.2_3.0_1724265101954.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chechen_en_5.4.2_3.0_1724265101954.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("chechen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("chechen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chechen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jiawei1998/CE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-chechen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-chechen_pipeline_en.md new file mode 100644 index 00000000000000..cc2c8014eaaa5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-chechen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English chechen_pipeline pipeline T5Transformer from jiawei1998 +author: John Snow Labs +name: chechen_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chechen_pipeline` is a English model originally trained by jiawei1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chechen_pipeline_en_5.4.2_3.0_1724265148094.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chechen_pipeline_en_5.4.2_3.0_1724265148094.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("chechen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("chechen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chechen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jiawei1998/CE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-checkpoint_tech_t5base_en.md b/docs/_posts/ahmedlone127/2024-08-21-checkpoint_tech_t5base_en.md new file mode 100644 index 00000000000000..c7f930f212f7ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-checkpoint_tech_t5base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English checkpoint_tech_t5base T5Transformer from sahithya20 +author: John Snow Labs +name: checkpoint_tech_t5base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`checkpoint_tech_t5base` is a English model originally trained by sahithya20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/checkpoint_tech_t5base_en_5.4.2_3.0_1724237165649.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/checkpoint_tech_t5base_en_5.4.2_3.0_1724237165649.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("checkpoint_tech_t5base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("checkpoint_tech_t5base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|checkpoint_tech_t5base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|920.8 MB| + +## References + +https://huggingface.co/sahithya20/checkpoint-tech-t5base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-checkpoint_tech_t5base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-checkpoint_tech_t5base_pipeline_en.md new file mode 100644 index 00000000000000..7c5e101d14af95 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-checkpoint_tech_t5base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English checkpoint_tech_t5base_pipeline pipeline T5Transformer from sahithya20 +author: John Snow Labs +name: checkpoint_tech_t5base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`checkpoint_tech_t5base_pipeline` is a English model originally trained by sahithya20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/checkpoint_tech_t5base_pipeline_en_5.4.2_3.0_1724237225328.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/checkpoint_tech_t5base_pipeline_en_5.4.2_3.0_1724237225328.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("checkpoint_tech_t5base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("checkpoint_tech_t5base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|checkpoint_tech_t5base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|920.8 MB| + +## References + +https://huggingface.co/sahithya20/checkpoint-tech-t5base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-clini_dialog_sum_t5_en.md b/docs/_posts/ahmedlone127/2024-08-21-clini_dialog_sum_t5_en.md new file mode 100644 index 00000000000000..55373433fa6680 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-clini_dialog_sum_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English clini_dialog_sum_t5 T5Transformer from dafraile +author: John Snow Labs +name: clini_dialog_sum_t5 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`clini_dialog_sum_t5` is a English model originally trained by dafraile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/clini_dialog_sum_t5_en_5.4.2_3.0_1724237793903.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/clini_dialog_sum_t5_en_5.4.2_3.0_1724237793903.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("clini_dialog_sum_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("clini_dialog_sum_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|clini_dialog_sum_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/dafraile/Clini-dialog-sum-T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-clini_dialog_sum_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-clini_dialog_sum_t5_pipeline_en.md new file mode 100644 index 00000000000000..a64c98f370d7bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-clini_dialog_sum_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English clini_dialog_sum_t5_pipeline pipeline T5Transformer from dafraile +author: John Snow Labs +name: clini_dialog_sum_t5_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`clini_dialog_sum_t5_pipeline` is a English model originally trained by dafraile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/clini_dialog_sum_t5_pipeline_en_5.4.2_3.0_1724237961135.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/clini_dialog_sum_t5_pipeline_en_5.4.2_3.0_1724237961135.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("clini_dialog_sum_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("clini_dialog_sum_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|clini_dialog_sum_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/dafraile/Clini-dialog-sum-T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cnn_news_summary_model_trained_on_reduced_data_cdillinger_en.md b/docs/_posts/ahmedlone127/2024-08-21-cnn_news_summary_model_trained_on_reduced_data_cdillinger_en.md new file mode 100644 index 00000000000000..3ecf29278325c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cnn_news_summary_model_trained_on_reduced_data_cdillinger_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cnn_news_summary_model_trained_on_reduced_data_cdillinger T5Transformer from cdillinger +author: John Snow Labs +name: cnn_news_summary_model_trained_on_reduced_data_cdillinger +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_news_summary_model_trained_on_reduced_data_cdillinger` is a English model originally trained by cdillinger. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_news_summary_model_trained_on_reduced_data_cdillinger_en_5.4.2_3.0_1724222914269.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_news_summary_model_trained_on_reduced_data_cdillinger_en_5.4.2_3.0_1724222914269.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cnn_news_summary_model_trained_on_reduced_data_cdillinger","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cnn_news_summary_model_trained_on_reduced_data_cdillinger", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_news_summary_model_trained_on_reduced_data_cdillinger| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|321.2 MB| + +## References + +https://huggingface.co/cdillinger/cnn_news_summary_model_trained_on_reduced_data \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline_en.md new file mode 100644 index 00000000000000..cf38538e3386ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline pipeline T5Transformer from cdillinger +author: John Snow Labs +name: cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline` is a English model originally trained by cdillinger. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline_en_5.4.2_3.0_1724222936274.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline_en_5.4.2_3.0_1724222936274.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cnn_news_summary_model_trained_on_reduced_data_cdillinger_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|321.2 MB| + +## References + +https://huggingface.co/cdillinger/cnn_news_summary_model_trained_on_reduced_data + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cola_en.md b/docs/_posts/ahmedlone127/2024-08-21-cola_en.md new file mode 100644 index 00000000000000..33cf93d76c8d5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cola_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cola T5Transformer from ShengdingHu +author: John Snow Labs +name: cola +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cola` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cola_en_5.4.2_3.0_1724247078986.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cola_en_5.4.2_3.0_1724247078986.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cola","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cola", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cola| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/cola \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cola_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-cola_pipeline_en.md new file mode 100644 index 00000000000000..886f77f3d759ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cola_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cola_pipeline pipeline T5Transformer from ShengdingHu +author: John Snow Labs +name: cola_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cola_pipeline` is a English model originally trained by ShengdingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cola_pipeline_en_5.4.2_3.0_1724247131556.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cola_pipeline_en_5.4.2_3.0_1724247131556.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cola_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cola_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cola_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ShengdingHu/cola + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-concat_icl_t5_lm_large_en.md b/docs/_posts/ahmedlone127/2024-08-21-concat_icl_t5_lm_large_en.md new file mode 100644 index 00000000000000..f4e144c08b32a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-concat_icl_t5_lm_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English concat_icl_t5_lm_large T5Transformer from qinyuany +author: John Snow Labs +name: concat_icl_t5_lm_large +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`concat_icl_t5_lm_large` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/concat_icl_t5_lm_large_en_5.4.2_3.0_1724211911090.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/concat_icl_t5_lm_large_en_5.4.2_3.0_1724211911090.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("concat_icl_t5_lm_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("concat_icl_t5_lm_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|concat_icl_t5_lm_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/qinyuany/concat-icl-t5-lm-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-concat_icl_t5_lm_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-concat_icl_t5_lm_large_pipeline_en.md new file mode 100644 index 00000000000000..1aceca4dae8ec7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-concat_icl_t5_lm_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English concat_icl_t5_lm_large_pipeline pipeline T5Transformer from qinyuany +author: John Snow Labs +name: concat_icl_t5_lm_large_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`concat_icl_t5_lm_large_pipeline` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/concat_icl_t5_lm_large_pipeline_en_5.4.2_3.0_1724212053462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/concat_icl_t5_lm_large_pipeline_en_5.4.2_3.0_1724212053462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("concat_icl_t5_lm_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("concat_icl_t5_lm_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|concat_icl_t5_lm_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/qinyuany/concat-icl-t5-lm-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-coref_mem_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-coref_mem_base_en.md new file mode 100644 index 00000000000000..d3836d703a97e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-coref_mem_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English coref_mem_base T5Transformer from eddieman78 +author: John Snow Labs +name: coref_mem_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`coref_mem_base` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/coref_mem_base_en_5.4.2_3.0_1724283796403.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/coref_mem_base_en_5.4.2_3.0_1724283796403.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("coref_mem_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("coref_mem_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|coref_mem_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/eddieman78/coref-mem-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-coref_mem_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-coref_mem_base_pipeline_en.md new file mode 100644 index 00000000000000..c28b243e1bdad5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-coref_mem_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English coref_mem_base_pipeline pipeline T5Transformer from eddieman78 +author: John Snow Labs +name: coref_mem_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`coref_mem_base_pipeline` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/coref_mem_base_pipeline_en_5.4.2_3.0_1724283843091.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/coref_mem_base_pipeline_en_5.4.2_3.0_1724283843091.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("coref_mem_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("coref_mem_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|coref_mem_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/eddieman78/coref-mem-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction0_paosl_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction0_paosl_v1_h1_en.md new file mode 100644 index 00000000000000..d1ee300c7fcc61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction0_paosl_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_paosl_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_paosl_v1_h1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_paosl_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_paosl_v1_h1_en_5.4.2_3.0_1724203185220.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_paosl_v1_h1_en_5.4.2_3.0_1724203185220.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_paosl_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_paosl_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_paosl_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_PAOSL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..a07d23e2edaf9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline_en_5.4.2_3.0_1724203383279.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline_en_5.4.2_3.0_1724203383279.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_paosl_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_PAOSL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction4_spoal_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction4_spoal_v1_en.md new file mode 100644 index 00000000000000..42d91615e7f62a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction4_spoal_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction4_spoal_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction4_spoal_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction4_spoal_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_spoal_v1_en_5.4.2_3.0_1724207090322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_spoal_v1_en_5.4.2_3.0_1724207090322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction4_spoal_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction4_spoal_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction4_spoal_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction4_SPOAL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline_en.md new file mode 100644 index 00000000000000..ee7d61339f771f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline_en_5.4.2_3.0_1724207263370.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline_en_5.4.2_3.0_1724207263370.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction4_spoal_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction4_SPOAL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_osapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_osapl_v1_en.md new file mode 100644 index 00000000000000..6b68d8ea679389 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_osapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_osapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_osapl_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_osapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_osapl_v1_en_5.4.2_3.0_1724281970809.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_osapl_v1_en_5.4.2_3.0_1724281970809.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_osapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_osapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_osapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OSAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline_en.md new file mode 100644 index 00000000000000..ceae47dbe7a07b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline_en_5.4.2_3.0_1724282145272.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline_en_5.4.2_3.0_1724282145272.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_osapl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OSAPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_ospal_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_ospal_v1_en.md new file mode 100644 index 00000000000000..5bb2455d933cbe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_ospal_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_ospal_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_ospal_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_ospal_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_v1_en_5.4.2_3.0_1724283010068.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_v1_en_5.4.2_3.0_1724283010068.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_ospal_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_ospal_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_ospal_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OSPAL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline_en.md new file mode 100644 index 00000000000000..e48df1fb1621f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline_en_5.4.2_3.0_1724283173899.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline_en_5.4.2_3.0_1724283173899.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_ospal_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OSPAL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_sapol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_sapol_v1_en.md new file mode 100644 index 00000000000000..2e4d089836bed3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_sapol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_sapol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_sapol_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_sapol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_sapol_v1_en_5.4.2_3.0_1724282708721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_sapol_v1_en_5.4.2_3.0_1724282708721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_sapol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_sapol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_sapol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_SAPOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline_en.md new file mode 100644 index 00000000000000..aaf24e2d401e17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline_en_5.4.2_3.0_1724282877754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline_en_5.4.2_3.0_1724282877754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_sapol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_SAPOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_spaol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_spaol_v1_en.md new file mode 100644 index 00000000000000..bf3602ff672e32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instruction4_spaol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction4_spaol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction4_spaol_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction4_spaol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_spaol_v1_en_5.4.2_3.0_1724270986602.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction4_spaol_v1_en_5.4.2_3.0_1724270986602.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_spaol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction4_spaol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction4_spaol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction4_SPAOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instructionn0_pasol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instructionn0_pasol_v1_en.md new file mode 100644 index 00000000000000..7c855206dc3684 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-cs505_coqe_vit5_train_instructionn0_pasol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_pasol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_pasol_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_pasol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_pasol_v1_en_5.4.2_3.0_1724229683542.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_pasol_v1_en_5.4.2_3.0_1724229683542.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_pasol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_pasol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_pasol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_PASOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dekingify_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-21-dekingify_t5_large_en.md new file mode 100644 index 00000000000000..618837bc9e5bed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dekingify_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dekingify_t5_large T5Transformer from swcrazyfan +author: John Snow Labs +name: dekingify_t5_large +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dekingify_t5_large` is a English model originally trained by swcrazyfan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dekingify_t5_large_en_5.4.2_3.0_1724273195164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dekingify_t5_large_en_5.4.2_3.0_1724273195164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dekingify_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dekingify_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dekingify_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/swcrazyfan/Dekingify-T5-Large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dekingify_t5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-dekingify_t5_large_pipeline_en.md new file mode 100644 index 00000000000000..76f38331ae69e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dekingify_t5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dekingify_t5_large_pipeline pipeline T5Transformer from swcrazyfan +author: John Snow Labs +name: dekingify_t5_large_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dekingify_t5_large_pipeline` is a English model originally trained by swcrazyfan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dekingify_t5_large_pipeline_en_5.4.2_3.0_1724273332243.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dekingify_t5_large_pipeline_en_5.4.2_3.0_1724273332243.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dekingify_t5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dekingify_t5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dekingify_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/swcrazyfan/Dekingify-T5-Large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-demo_flan_t5_small_8bit_en.md b/docs/_posts/ahmedlone127/2024-08-21-demo_flan_t5_small_8bit_en.md new file mode 100644 index 00000000000000..04e462704aea7b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-demo_flan_t5_small_8bit_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English demo_flan_t5_small_8bit T5Transformer from iliemihai +author: John Snow Labs +name: demo_flan_t5_small_8bit +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`demo_flan_t5_small_8bit` is a English model originally trained by iliemihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/demo_flan_t5_small_8bit_en_5.4.2_3.0_1724273005500.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/demo_flan_t5_small_8bit_en_5.4.2_3.0_1724273005500.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("demo_flan_t5_small_8bit","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("demo_flan_t5_small_8bit", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|demo_flan_t5_small_8bit| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|151.7 MB| + +## References + +https://huggingface.co/iliemihai/demo-flan-t5-small-8bit \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-demo_flan_t5_small_8bit_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-demo_flan_t5_small_8bit_pipeline_en.md new file mode 100644 index 00000000000000..74d57247d9f8cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-demo_flan_t5_small_8bit_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English demo_flan_t5_small_8bit_pipeline pipeline T5Transformer from iliemihai +author: John Snow Labs +name: demo_flan_t5_small_8bit_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`demo_flan_t5_small_8bit_pipeline` is a English model originally trained by iliemihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/demo_flan_t5_small_8bit_pipeline_en_5.4.2_3.0_1724273043241.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/demo_flan_t5_small_8bit_pipeline_en_5.4.2_3.0_1724273043241.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("demo_flan_t5_small_8bit_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("demo_flan_t5_small_8bit_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|demo_flan_t5_small_8bit_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|151.7 MB| + +## References + +https://huggingface.co/iliemihai/demo-flan-t5-small-8bit + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-denoice_finetuned_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-21-denoice_finetuned_xsum_en.md new file mode 100644 index 00000000000000..7d89f09087a99d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-denoice_finetuned_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English denoice_finetuned_xsum T5Transformer from CodeIsAbstract +author: John Snow Labs +name: denoice_finetuned_xsum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`denoice_finetuned_xsum` is a English model originally trained by CodeIsAbstract. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/denoice_finetuned_xsum_en_5.4.2_3.0_1724263669090.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/denoice_finetuned_xsum_en_5.4.2_3.0_1724263669090.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("denoice_finetuned_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("denoice_finetuned_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|denoice_finetuned_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|112.2 MB| + +## References + +https://huggingface.co/CodeIsAbstract/denoice-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-denoice_finetuned_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-denoice_finetuned_xsum_pipeline_en.md new file mode 100644 index 00000000000000..c58582504dae8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-denoice_finetuned_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English denoice_finetuned_xsum_pipeline pipeline T5Transformer from CodeIsAbstract +author: John Snow Labs +name: denoice_finetuned_xsum_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`denoice_finetuned_xsum_pipeline` is a English model originally trained by CodeIsAbstract. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/denoice_finetuned_xsum_pipeline_en_5.4.2_3.0_1724263676639.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/denoice_finetuned_xsum_pipeline_en_5.4.2_3.0_1724263676639.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("denoice_finetuned_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("denoice_finetuned_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|denoice_finetuned_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|112.2 MB| + +## References + +https://huggingface.co/CodeIsAbstract/denoice-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dgslow_t5_small_pc_en.md b/docs/_posts/ahmedlone127/2024-08-21-dgslow_t5_small_pc_en.md new file mode 100644 index 00000000000000..b14846c4914f9e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dgslow_t5_small_pc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dgslow_t5_small_pc T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_pc +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_pc` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_pc_en_5.4.2_3.0_1724231294385.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_pc_en_5.4.2_3.0_1724231294385.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dgslow_t5_small_pc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dgslow_t5_small_pc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_pc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|324.2 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_PC \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dgslow_t5_small_pc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-dgslow_t5_small_pc_pipeline_en.md new file mode 100644 index 00000000000000..ff541f2667bc96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dgslow_t5_small_pc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dgslow_t5_small_pc_pipeline pipeline T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_pc_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_pc_pipeline` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_pc_pipeline_en_5.4.2_3.0_1724231317713.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_pc_pipeline_en_5.4.2_3.0_1724231317713.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dgslow_t5_small_pc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dgslow_t5_small_pc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_pc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|324.2 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_PC + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dialect_declare_lab_en.md b/docs/_posts/ahmedlone127/2024-08-21-dialect_declare_lab_en.md new file mode 100644 index 00000000000000..fa0016f669bce4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dialect_declare_lab_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dialect_declare_lab T5Transformer from declare-lab +author: John Snow Labs +name: dialect_declare_lab +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialect_declare_lab` is a English model originally trained by declare-lab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialect_declare_lab_en_5.4.2_3.0_1724270945793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialect_declare_lab_en_5.4.2_3.0_1724270945793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dialect_declare_lab","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dialect_declare_lab", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialect_declare_lab| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/declare-lab/dialect \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dialect_declare_lab_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-dialect_declare_lab_pipeline_en.md new file mode 100644 index 00000000000000..8f9ecfe6f4879d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dialect_declare_lab_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dialect_declare_lab_pipeline pipeline T5Transformer from declare-lab +author: John Snow Labs +name: dialect_declare_lab_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialect_declare_lab_pipeline` is a English model originally trained by declare-lab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialect_declare_lab_pipeline_en_5.4.2_3.0_1724271104334.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialect_declare_lab_pipeline_en_5.4.2_3.0_1724271104334.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dialect_declare_lab_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dialect_declare_lab_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialect_declare_lab_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/declare-lab/dialect + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dialect_shensq0814_en.md b/docs/_posts/ahmedlone127/2024-08-21-dialect_shensq0814_en.md new file mode 100644 index 00000000000000..c7c589a7c2c670 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dialect_shensq0814_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dialect_shensq0814 T5Transformer from shensq0814 +author: John Snow Labs +name: dialect_shensq0814 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialect_shensq0814` is a English model originally trained by shensq0814. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialect_shensq0814_en_5.4.2_3.0_1724242126880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialect_shensq0814_en_5.4.2_3.0_1724242126880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dialect_shensq0814","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dialect_shensq0814", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialect_shensq0814| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/shensq0814/DIALECT \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dialect_shensq0814_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-dialect_shensq0814_pipeline_en.md new file mode 100644 index 00000000000000..b5c08bbcf73bd2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dialect_shensq0814_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dialect_shensq0814_pipeline pipeline T5Transformer from shensq0814 +author: John Snow Labs +name: dialect_shensq0814_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialect_shensq0814_pipeline` is a English model originally trained by shensq0814. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialect_shensq0814_pipeline_en_5.4.2_3.0_1724242271813.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialect_shensq0814_pipeline_en_5.4.2_3.0_1724242271813.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dialect_shensq0814_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dialect_shensq0814_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialect_shensq0814_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/shensq0814/DIALECT + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_base_20ep_en.md b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_base_20ep_en.md new file mode 100644 index 00000000000000..c2158349d95965 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_base_20ep_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_base_20ep T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_base_20ep +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_base_20ep` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_base_20ep_en_5.4.2_3.0_1724224812119.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_base_20ep_en_5.4.2_3.0_1724224812119.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_base_20ep","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_base_20ep", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_base_20ep| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled_mt5-base_20ep \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_base_20ep_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_base_20ep_pipeline_en.md new file mode 100644 index 00000000000000..0da509486c3d52 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_base_20ep_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_base_20ep_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_base_20ep_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_base_20ep_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_base_20ep_pipeline_en_5.4.2_3.0_1724224905788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_base_20ep_pipeline_en_5.4.2_3.0_1724224905788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_base_20ep_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_base_20ep_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_base_20ep_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled_mt5-base_20ep + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_0_0_5_en.md b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_0_0_5_en.md new file mode 100644 index 00000000000000..82459993d29540 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_0_0_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_0_0_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_0_0_5 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_0_0_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_0_0_5_en_5.4.2_3.0_1724266096532.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_0_0_5_en_5.4.2_3.0_1724266096532.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_0_0_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_0_0_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_0_0_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.0-0.5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_0_0_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_0_0_5_pipeline_en.md new file mode 100644 index 00000000000000..69911b38fe9601 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_0_0_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_0_0_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_0_0_5_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_0_0_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_0_0_5_pipeline_en_5.4.2_3.0_1724266284642.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_0_0_5_pipeline_en_5.4.2_3.0_1724266284642.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_0_0_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_0_0_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_0_0_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.0-0.5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_6_0_5_en.md b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_6_0_5_en.md new file mode 100644 index 00000000000000..9b619738ccc96e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_6_0_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_6_0_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_6_0_5 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_6_0_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_0_5_en_5.4.2_3.0_1724200232555.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_0_5_en_5.4.2_3.0_1724200232555.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_6_0_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_6_0_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_6_0_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.6-0.5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_6_0_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_6_0_5_pipeline_en.md new file mode 100644 index 00000000000000..0e003f46eff996 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_0_6_0_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_6_0_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_6_0_5_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_6_0_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_0_5_pipeline_en_5.4.2_3.0_1724200427252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_0_5_pipeline_en_5.4.2_3.0_1724200427252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_6_0_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_6_0_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_6_0_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.6-0.5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_b0_04_en.md b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_b0_04_en.md new file mode 100644 index 00000000000000..0969265a4ad3a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_b0_04_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_b0_04 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b0_04 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b0_04` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_04_en_5.4.2_3.0_1724266768811.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_04_en_5.4.2_3.0_1724266768811.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_b0_04","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_b0_04", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b0_04| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b0.04 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_b0_04_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_b0_04_pipeline_en.md new file mode 100644 index 00000000000000..8b0dc12139f48d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-distilled_mt5_small_b0_04_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_b0_04_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b0_04_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b0_04_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_04_pipeline_en_5.4.2_3.0_1724266959781.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_04_pipeline_en_5.4.2_3.0_1724266959781.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_b0_04_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_b0_04_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b0_04_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b0.04 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dvt5_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-dvt5_base_en.md new file mode 100644 index 00000000000000..b118fa84f5f710 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dvt5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dvt5_base T5Transformer from chopey +author: John Snow Labs +name: dvt5_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dvt5_base` is a English model originally trained by chopey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dvt5_base_en_5.4.2_3.0_1724284371312.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dvt5_base_en_5.4.2_3.0_1724284371312.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dvt5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dvt5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dvt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|390.0 MB| + +## References + +https://huggingface.co/chopey/dvt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-dvt5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-dvt5_base_pipeline_en.md new file mode 100644 index 00000000000000..bcd49f2badb5ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-dvt5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dvt5_base_pipeline pipeline T5Transformer from chopey +author: John Snow Labs +name: dvt5_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dvt5_base_pipeline` is a English model originally trained by chopey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dvt5_base_pipeline_en_5.4.2_3.0_1724284505427.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dvt5_base_pipeline_en_5.4.2_3.0_1724284505427.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dvt5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dvt5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dvt5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|390.0 MB| + +## References + +https://huggingface.co/chopey/dvt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-e2e_flan_large_noscore_en.md b/docs/_posts/ahmedlone127/2024-08-21-e2e_flan_large_noscore_en.md new file mode 100644 index 00000000000000..38360b5475fdce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-e2e_flan_large_noscore_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English e2e_flan_large_noscore T5Transformer from divers +author: John Snow Labs +name: e2e_flan_large_noscore +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`e2e_flan_large_noscore` is a English model originally trained by divers. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/e2e_flan_large_noscore_en_5.4.2_3.0_1724232239883.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/e2e_flan_large_noscore_en_5.4.2_3.0_1724232239883.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("e2e_flan_large_noscore","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("e2e_flan_large_noscore", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|e2e_flan_large_noscore| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/divers/e2e-flan-large-noscore \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-e2e_flan_large_noscore_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-e2e_flan_large_noscore_pipeline_en.md new file mode 100644 index 00000000000000..c9519cef7544ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-e2e_flan_large_noscore_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English e2e_flan_large_noscore_pipeline pipeline T5Transformer from divers +author: John Snow Labs +name: e2e_flan_large_noscore_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`e2e_flan_large_noscore_pipeline` is a English model originally trained by divers. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/e2e_flan_large_noscore_pipeline_en_5.4.2_3.0_1724232379222.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/e2e_flan_large_noscore_pipeline_en_5.4.2_3.0_1724232379222.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("e2e_flan_large_noscore_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("e2e_flan_large_noscore_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|e2e_flan_large_noscore_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/divers/e2e-flan-large-noscore + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ea_24_en.md b/docs/_posts/ahmedlone127/2024-08-21-ea_24_en.md new file mode 100644 index 00000000000000..8851f4ded4aee1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ea_24_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ea_24 T5Transformer from butterflytech +author: John Snow Labs +name: ea_24 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ea_24` is a English model originally trained by butterflytech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ea_24_en_5.4.2_3.0_1724282080106.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ea_24_en_5.4.2_3.0_1724282080106.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ea_24","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ea_24", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ea_24| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|970.4 MB| + +## References + +https://huggingface.co/butterflytech/ea-24 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ea_24_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-ea_24_pipeline_en.md new file mode 100644 index 00000000000000..1932da010af6b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ea_24_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ea_24_pipeline pipeline T5Transformer from butterflytech +author: John Snow Labs +name: ea_24_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ea_24_pipeline` is a English model originally trained by butterflytech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ea_24_pipeline_en_5.4.2_3.0_1724282135627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ea_24_pipeline_en_5.4.2_3.0_1724282135627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ea_24_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ea_24_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ea_24_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|970.4 MB| + +## References + +https://huggingface.co/butterflytech/ea-24 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-eng_tec_en.md b/docs/_posts/ahmedlone127/2024-08-21-eng_tec_en.md new file mode 100644 index 00000000000000..1f9066dd0a579f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-eng_tec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English eng_tec T5Transformer from KES +author: John Snow Labs +name: eng_tec +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`eng_tec` is a English model originally trained by KES. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/eng_tec_en_5.4.2_3.0_1724257871519.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/eng_tec_en_5.4.2_3.0_1724257871519.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("eng_tec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("eng_tec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|eng_tec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|992.6 MB| + +## References + +https://huggingface.co/KES/ENG-TEC \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-eng_tec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-eng_tec_pipeline_en.md new file mode 100644 index 00000000000000..c51a863843f2f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-eng_tec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English eng_tec_pipeline pipeline T5Transformer from KES +author: John Snow Labs +name: eng_tec_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`eng_tec_pipeline` is a English model originally trained by KES. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/eng_tec_pipeline_en_5.4.2_3.0_1724257927191.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/eng_tec_pipeline_en_5.4.2_3.0_1724257927191.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("eng_tec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("eng_tec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|eng_tec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|992.6 MB| + +## References + +https://huggingface.co/KES/ENG-TEC + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-english_mrm8488_spider_en.md b/docs/_posts/ahmedlone127/2024-08-21-english_mrm8488_spider_en.md new file mode 100644 index 00000000000000..0fc21728ffa832 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-english_mrm8488_spider_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_mrm8488_spider T5Transformer from e22vvb +author: John Snow Labs +name: english_mrm8488_spider +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mrm8488_spider` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mrm8488_spider_en_5.4.2_3.0_1724268739783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mrm8488_spider_en_5.4.2_3.0_1724268739783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_mrm8488_spider","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_mrm8488_spider", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mrm8488_spider| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.0 MB| + +## References + +https://huggingface.co/e22vvb/EN_mrm8488_spider \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-english_mrm8488_spider_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-english_mrm8488_spider_pipeline_en.md new file mode 100644 index 00000000000000..0156d391a3c9f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-english_mrm8488_spider_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_mrm8488_spider_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_mrm8488_spider_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mrm8488_spider_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mrm8488_spider_pipeline_en_5.4.2_3.0_1724268760697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mrm8488_spider_pipeline_en_5.4.2_3.0_1724268760697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_mrm8488_spider_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_mrm8488_spider_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mrm8488_spider_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.0 MB| + +## References + +https://huggingface.co/e22vvb/EN_mrm8488_spider + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-english_t5base_en.md b/docs/_posts/ahmedlone127/2024-08-21-english_t5base_en.md new file mode 100644 index 00000000000000..87ae282f7d4aa4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-english_t5base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_t5base T5Transformer from webnlg +author: John Snow Labs +name: english_t5base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5base` is a English model originally trained by webnlg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5base_en_5.4.2_3.0_1724225543364.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5base_en_5.4.2_3.0_1724225543364.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_t5base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_t5base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/webnlg/en-t5base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-english_t5base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-english_t5base_pipeline_en.md new file mode 100644 index 00000000000000..1897c799815e36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-english_t5base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_t5base_pipeline pipeline T5Transformer from webnlg +author: John Snow Labs +name: english_t5base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5base_pipeline` is a English model originally trained by webnlg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5base_pipeline_en_5.4.2_3.0_1724225593070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5base_pipeline_en_5.4.2_3.0_1724225593070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_t5base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_t5base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/webnlg/en-t5base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-english_vietnamese_envit5_translation_docs_news_train_en.md b/docs/_posts/ahmedlone127/2024-08-21-english_vietnamese_envit5_translation_docs_news_train_en.md new file mode 100644 index 00000000000000..fd64cce98c581f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-english_vietnamese_envit5_translation_docs_news_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_vietnamese_envit5_translation_docs_news_train T5Transformer from hungphongtrn +author: John Snow Labs +name: english_vietnamese_envit5_translation_docs_news_train +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_vietnamese_envit5_translation_docs_news_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_vietnamese_envit5_translation_docs_news_train_en_5.4.2_3.0_1724267907412.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_vietnamese_envit5_translation_docs_news_train_en_5.4.2_3.0_1724267907412.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_vietnamese_envit5_translation_docs_news_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_vietnamese_envit5_translation_docs_news_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_vietnamese_envit5_translation_docs_news_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/en_vi_envit5-translation_docs_news_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-english_vietnamese_envit5_translation_docs_news_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-english_vietnamese_envit5_translation_docs_news_train_pipeline_en.md new file mode 100644 index 00000000000000..67cd0dc8e92106 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-english_vietnamese_envit5_translation_docs_news_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_vietnamese_envit5_translation_docs_news_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: english_vietnamese_envit5_translation_docs_news_train_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_vietnamese_envit5_translation_docs_news_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_vietnamese_envit5_translation_docs_news_train_pipeline_en_5.4.2_3.0_1724267981447.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_vietnamese_envit5_translation_docs_news_train_pipeline_en_5.4.2_3.0_1724267981447.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_vietnamese_envit5_translation_docs_news_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_vietnamese_envit5_translation_docs_news_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_vietnamese_envit5_translation_docs_news_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/en_vi_envit5-translation_docs_news_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ent5_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-ent5_base_en.md new file mode 100644 index 00000000000000..231bb83c4e5524 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ent5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ent5_base T5Transformer from igorktech +author: John Snow Labs +name: ent5_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ent5_base` is a English model originally trained by igorktech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ent5_base_en_5.4.2_3.0_1724250415268.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ent5_base_en_5.4.2_3.0_1724250415268.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ent5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ent5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ent5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|467.5 MB| + +## References + +https://huggingface.co/igorktech/ent5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ent5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-ent5_base_pipeline_en.md new file mode 100644 index 00000000000000..134b4782df4a0d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ent5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ent5_base_pipeline pipeline T5Transformer from igorktech +author: John Snow Labs +name: ent5_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ent5_base_pipeline` is a English model originally trained by igorktech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ent5_base_pipeline_en_5.4.2_3.0_1724250580811.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ent5_base_pipeline_en_5.4.2_3.0_1724250580811.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ent5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ent5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ent5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|467.5 MB| + +## References + +https://huggingface.co/igorktech/ent5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-est5_base_es.md b/docs/_posts/ahmedlone127/2024-08-21-est5_base_es.md new file mode 100644 index 00000000000000..f439f3469e8149 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-est5_base_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish est5_base T5Transformer from hiiamsid +author: John Snow Labs +name: est5_base +date: 2024-08-21 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`est5_base` is a Castilian, Spanish model originally trained by hiiamsid. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/est5_base_es_5.4.2_3.0_1724200360932.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/est5_base_es_5.4.2_3.0_1724200360932.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("est5_base","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("est5_base", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|est5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|491.9 MB| + +## References + +https://huggingface.co/hiiamsid/est5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-est5_base_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-21-est5_base_pipeline_es.md new file mode 100644 index 00000000000000..3baa02e8c8d8d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-est5_base_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish est5_base_pipeline pipeline T5Transformer from hiiamsid +author: John Snow Labs +name: est5_base_pipeline +date: 2024-08-21 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`est5_base_pipeline` is a Castilian, Spanish model originally trained by hiiamsid. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/est5_base_pipeline_es_5.4.2_3.0_1724200533554.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/est5_base_pipeline_es_5.4.2_3.0_1724200533554.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("est5_base_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("est5_base_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|est5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|491.9 MB| + +## References + +https://huggingface.co/hiiamsid/est5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-et5_typos_corrector_ko.md b/docs/_posts/ahmedlone127/2024-08-21-et5_typos_corrector_ko.md new file mode 100644 index 00000000000000..6bf1f3817732cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-et5_typos_corrector_ko.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Korean et5_typos_corrector T5Transformer from j5ng +author: John Snow Labs +name: et5_typos_corrector +date: 2024-08-21 +tags: [ko, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`et5_typos_corrector` is a Korean model originally trained by j5ng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/et5_typos_corrector_ko_5.4.2_3.0_1724216193142.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/et5_typos_corrector_ko_5.4.2_3.0_1724216193142.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("et5_typos_corrector","ko") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("et5_typos_corrector", "ko") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|et5_typos_corrector| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ko| +|Size:|1.3 GB| + +## References + +https://huggingface.co/j5ng/et5-typos-corrector \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-et5_typos_corrector_pipeline_ko.md b/docs/_posts/ahmedlone127/2024-08-21-et5_typos_corrector_pipeline_ko.md new file mode 100644 index 00000000000000..75cd44b6fae634 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-et5_typos_corrector_pipeline_ko.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Korean et5_typos_corrector_pipeline pipeline T5Transformer from j5ng +author: John Snow Labs +name: et5_typos_corrector_pipeline +date: 2024-08-21 +tags: [ko, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`et5_typos_corrector_pipeline` is a Korean model originally trained by j5ng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/et5_typos_corrector_pipeline_ko_5.4.2_3.0_1724216263090.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/et5_typos_corrector_pipeline_ko_5.4.2_3.0_1724216263090.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("et5_typos_corrector_pipeline", lang = "ko") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("et5_typos_corrector_pipeline", lang = "ko") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|et5_typos_corrector_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ko| +|Size:|1.3 GB| + +## References + +https://huggingface.co/j5ng/et5-typos-corrector + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-fid_icl_t5_lm_large_en.md b/docs/_posts/ahmedlone127/2024-08-21-fid_icl_t5_lm_large_en.md new file mode 100644 index 00000000000000..d46bb330ecb648 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-fid_icl_t5_lm_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fid_icl_t5_lm_large T5Transformer from qinyuany +author: John Snow Labs +name: fid_icl_t5_lm_large +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fid_icl_t5_lm_large` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fid_icl_t5_lm_large_en_5.4.2_3.0_1724248305021.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fid_icl_t5_lm_large_en_5.4.2_3.0_1724248305021.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fid_icl_t5_lm_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fid_icl_t5_lm_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fid_icl_t5_lm_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/qinyuany/fid-icl-t5-lm-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-fid_icl_t5_lm_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-fid_icl_t5_lm_large_pipeline_en.md new file mode 100644 index 00000000000000..c3b868327944f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-fid_icl_t5_lm_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fid_icl_t5_lm_large_pipeline pipeline T5Transformer from qinyuany +author: John Snow Labs +name: fid_icl_t5_lm_large_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fid_icl_t5_lm_large_pipeline` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fid_icl_t5_lm_large_pipeline_en_5.4.2_3.0_1724248439522.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fid_icl_t5_lm_large_pipeline_en_5.4.2_3.0_1724248439522.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fid_icl_t5_lm_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fid_icl_t5_lm_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fid_icl_t5_lm_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/qinyuany/fid-icl-t5-lm-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-fidt5_base_nq_en.md b/docs/_posts/ahmedlone127/2024-08-21-fidt5_base_nq_en.md new file mode 100644 index 00000000000000..85e34037ae0a2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-fidt5_base_nq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fidt5_base_nq T5Transformer from DylanJHJ +author: John Snow Labs +name: fidt5_base_nq +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fidt5_base_nq` is a English model originally trained by DylanJHJ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fidt5_base_nq_en_5.4.2_3.0_1724217841962.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fidt5_base_nq_en_5.4.2_3.0_1724217841962.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fidt5_base_nq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fidt5_base_nq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fidt5_base_nq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/DylanJHJ/fidt5-base-nq \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-fidt5_base_nq_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-fidt5_base_nq_pipeline_en.md new file mode 100644 index 00000000000000..30cdd2111874fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-fidt5_base_nq_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fidt5_base_nq_pipeline pipeline T5Transformer from DylanJHJ +author: John Snow Labs +name: fidt5_base_nq_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fidt5_base_nq_pipeline` is a English model originally trained by DylanJHJ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fidt5_base_nq_pipeline_en_5.4.2_3.0_1724217894278.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fidt5_base_nq_pipeline_en_5.4.2_3.0_1724217894278.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fidt5_base_nq_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fidt5_base_nq_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fidt5_base_nq_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/DylanJHJ/fidt5-base-nq + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-final_sahithya20_en.md b/docs/_posts/ahmedlone127/2024-08-21-final_sahithya20_en.md new file mode 100644 index 00000000000000..564dafc64e9aed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-final_sahithya20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English final_sahithya20 T5Transformer from sahithya20 +author: John Snow Labs +name: final_sahithya20 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`final_sahithya20` is a English model originally trained by sahithya20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/final_sahithya20_en_5.4.2_3.0_1724263899697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/final_sahithya20_en_5.4.2_3.0_1724263899697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("final_sahithya20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("final_sahithya20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|final_sahithya20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|303.8 MB| + +## References + +https://huggingface.co/sahithya20/final \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-final_sahithya20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-final_sahithya20_pipeline_en.md new file mode 100644 index 00000000000000..567b2fb617b34e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-final_sahithya20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English final_sahithya20_pipeline pipeline T5Transformer from sahithya20 +author: John Snow Labs +name: final_sahithya20_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`final_sahithya20_pipeline` is a English model originally trained by sahithya20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/final_sahithya20_pipeline_en_5.4.2_3.0_1724263923288.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/final_sahithya20_pipeline_en_5.4.2_3.0_1724263923288.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("final_sahithya20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("final_sahithya20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|final_sahithya20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|303.8 MB| + +## References + +https://huggingface.co/sahithya20/final + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-fine_tuned_rabeya_en.md b/docs/_posts/ahmedlone127/2024-08-21-fine_tuned_rabeya_en.md new file mode 100644 index 00000000000000..c373c0e6dffd2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-fine_tuned_rabeya_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English fine_tuned_rabeya T5Transformer from Rabeya +author: John Snow Labs +name: fine_tuned_rabeya +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_rabeya` is a English model originally trained by Rabeya. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_rabeya_en_5.4.2_3.0_1724251995612.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_rabeya_en_5.4.2_3.0_1724251995612.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("fine_tuned_rabeya","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("fine_tuned_rabeya", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_rabeya| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Rabeya/fine_tuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-fine_tuned_rabeya_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-fine_tuned_rabeya_pipeline_en.md new file mode 100644 index 00000000000000..ee41e3a63fc176 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-fine_tuned_rabeya_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English fine_tuned_rabeya_pipeline pipeline T5Transformer from Rabeya +author: John Snow Labs +name: fine_tuned_rabeya_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`fine_tuned_rabeya_pipeline` is a English model originally trained by Rabeya. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/fine_tuned_rabeya_pipeline_en_5.4.2_3.0_1724252043624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/fine_tuned_rabeya_pipeline_en_5.4.2_3.0_1724252043624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("fine_tuned_rabeya_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("fine_tuned_rabeya_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|fine_tuned_rabeya_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Rabeya/fine_tuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-finetune_sagemaker_demo_en.md b/docs/_posts/ahmedlone127/2024-08-21-finetune_sagemaker_demo_en.md new file mode 100644 index 00000000000000..fe6c7f73b16fb1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-finetune_sagemaker_demo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_sagemaker_demo T5Transformer from madhav-devrev +author: John Snow Labs +name: finetune_sagemaker_demo +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_sagemaker_demo` is a English model originally trained by madhav-devrev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_sagemaker_demo_en_5.4.2_3.0_1724237952348.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_sagemaker_demo_en_5.4.2_3.0_1724237952348.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_sagemaker_demo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_sagemaker_demo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_sagemaker_demo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/madhav-devrev/finetune-sagemaker-demo \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-finetune_sagemaker_demo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-finetune_sagemaker_demo_pipeline_en.md new file mode 100644 index 00000000000000..c86e9d93bd62b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-finetune_sagemaker_demo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_sagemaker_demo_pipeline pipeline T5Transformer from madhav-devrev +author: John Snow Labs +name: finetune_sagemaker_demo_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_sagemaker_demo_pipeline` is a English model originally trained by madhav-devrev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_sagemaker_demo_pipeline_en_5.4.2_3.0_1724237969728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_sagemaker_demo_pipeline_en_5.4.2_3.0_1724237969728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_sagemaker_demo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_sagemaker_demo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_sagemaker_demo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/madhav-devrev/finetune-sagemaker-demo + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-finetune_summarization_t5_small_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-21-finetune_summarization_t5_small_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..9fc60428912506 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-finetune_summarization_t5_small_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_summarization_t5_small_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_summarization_t5_small_standard_bahasa_cased +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_summarization_t5_small_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_summarization_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724218165795.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_summarization_t5_small_standard_bahasa_cased_en_5.4.2_3.0_1724218165795.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_summarization_t5_small_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_summarization_t5_small_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_summarization_t5_small_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mesolitica/finetune-summarization-t5-small-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-finetune_summarization_t5_small_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-finetune_summarization_t5_small_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..41deb33fca0dc3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-finetune_summarization_t5_small_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_summarization_t5_small_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_summarization_t5_small_standard_bahasa_cased_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_summarization_t5_small_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_summarization_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724218184854.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_summarization_t5_small_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724218184854.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_summarization_t5_small_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_summarization_t5_small_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_summarization_t5_small_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/mesolitica/finetune-summarization-t5-small-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_en.md b/docs/_posts/ahmedlone127/2024-08-21-finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_en.md new file mode 100644 index 00000000000000..8839d6b9393db9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96 T5Transformer from liuyanchen1015 +author: John Snow Labs +name: finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_en_5.4.2_3.0_1724263042836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_en_5.4.2_3.0_1724263042836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/Finetuned_FLAN-T5_VALUE_adapterfusion_lr1e-4_bs96 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline_en.md new file mode 100644 index 00000000000000..a7cbb9d9eea8af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline pipeline T5Transformer from liuyanchen1015 +author: John Snow Labs +name: finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline` is a English model originally trained by liuyanchen1015. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline_en_5.4.2_3.0_1724263091364.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline_en_5.4.2_3.0_1724263091364.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_flan_t5_value_adapterfusion_lr1e_4_bs96_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/liuyanchen1015/Finetuned_FLAN-T5_VALUE_adapterfusion_lr1e-4_bs96 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_oig_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_oig_base_en.md new file mode 100644 index 00000000000000..52fe66a8b0b98e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_oig_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_oig_base T5Transformer from 0-hero +author: John Snow Labs +name: flan_oig_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_oig_base` is a English model originally trained by 0-hero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_oig_base_en_5.4.2_3.0_1724249084855.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_oig_base_en_5.4.2_3.0_1724249084855.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_oig_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_oig_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_oig_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/0-hero/flan-OIG-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_oig_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_oig_base_pipeline_en.md new file mode 100644 index 00000000000000..a4108899b65af7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_oig_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_oig_base_pipeline pipeline T5Transformer from 0-hero +author: John Snow Labs +name: flan_oig_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_oig_base_pipeline` is a English model originally trained by 0-hero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_oig_base_pipeline_en_5.4.2_3.0_1724249132106.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_oig_base_pipeline_en_5.4.2_3.0_1724249132106.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_oig_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_oig_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_oig_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/0-hero/flan-OIG-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_small_mc_question_options_generation_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_small_mc_question_options_generation_en.md new file mode 100644 index 00000000000000..e27682d68ec3b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_small_mc_question_options_generation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_small_mc_question_options_generation T5Transformer from Michelvh +author: John Snow Labs +name: flan_small_mc_question_options_generation +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_small_mc_question_options_generation` is a English model originally trained by Michelvh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_small_mc_question_options_generation_en_5.4.2_3.0_1724266744315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_small_mc_question_options_generation_en_5.4.2_3.0_1724266744315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_small_mc_question_options_generation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_small_mc_question_options_generation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_small_mc_question_options_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/Michelvh/flan-small-mc-question-options-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_small_mc_question_options_generation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_small_mc_question_options_generation_pipeline_en.md new file mode 100644 index 00000000000000..a74345cb629112 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_small_mc_question_options_generation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_small_mc_question_options_generation_pipeline pipeline T5Transformer from Michelvh +author: John Snow Labs +name: flan_small_mc_question_options_generation_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_small_mc_question_options_generation_pipeline` is a English model originally trained by Michelvh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_small_mc_question_options_generation_pipeline_en_5.4.2_3.0_1724266760420.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_small_mc_question_options_generation_pipeline_en_5.4.2_3.0_1724266760420.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_small_mc_question_options_generation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_small_mc_question_options_generation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_small_mc_question_options_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/Michelvh/flan-small-mc-question-options-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_4_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_4_cnndm_en.md new file mode 100644 index 00000000000000..bff2612133e91d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_4_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_4_4_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_4_4_cnndm +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_4_4_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_4_4_cnndm_en_5.4.2_3.0_1724243037745.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_4_4_cnndm_en_5.4.2_3.0_1724243037745.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_4_4_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_4_4_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_4_4_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|771.7 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-4-4-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_4_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_4_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..b409b94d578a02 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_4_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_4_4_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_4_4_cnndm_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_4_4_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_4_4_cnndm_pipeline_en_5.4.2_3.0_1724243076131.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_4_4_cnndm_pipeline_en_5.4.2_3.0_1724243076131.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_4_4_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_4_4_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_4_4_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|771.7 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-4-4-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_6_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_6_cnndm_en.md new file mode 100644 index 00000000000000..6570c74a4e75e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_6_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_4_6_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_4_6_cnndm +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_4_6_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_4_6_cnndm_en_5.4.2_3.0_1724243262187.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_4_6_cnndm_en_5.4.2_3.0_1724243262187.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_4_6_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_4_6_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_4_6_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|913.1 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-4-6-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_6_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_6_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..9e11f63bf15ab6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_4_6_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_4_6_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_4_6_cnndm_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_4_6_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_4_6_cnndm_pipeline_en_5.4.2_3.0_1724243309366.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_4_6_cnndm_pipeline_en_5.4.2_3.0_1724243309366.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_4_6_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_4_6_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_4_6_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|913.1 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-4-6-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_cnndm_en.md new file mode 100644 index 00000000000000..82e765c5296176 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_5_5_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_5_5_cnndm +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_5_5_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_5_5_cnndm_en_5.4.2_3.0_1724228814638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_5_5_cnndm_en_5.4.2_3.0_1724228814638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_5_5_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_5_5_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_5_5_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|895.4 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-5-5-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..26ea77d654a5d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_5_5_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_5_5_cnndm_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_5_5_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_5_5_cnndm_pipeline_en_5.4.2_3.0_1724228868546.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_5_5_cnndm_pipeline_en_5.4.2_3.0_1724228868546.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_5_5_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_5_5_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_5_5_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|895.4 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-5-5-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_xsum_en.md new file mode 100644 index 00000000000000..03fe2ef0d0cb41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_5_5_xsum T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_5_5_xsum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_5_5_xsum` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_5_5_xsum_en_5.4.2_3.0_1724258360518.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_5_5_xsum_en_5.4.2_3.0_1724258360518.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_5_5_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_5_5_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_5_5_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|895.4 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-5-5-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_xsum_pipeline_en.md new file mode 100644 index 00000000000000..162485049a8602 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_5_5_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_5_5_xsum_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_5_5_xsum_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_5_5_xsum_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_5_5_xsum_pipeline_en_5.4.2_3.0_1724258402362.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_5_5_xsum_pipeline_en_5.4.2_3.0_1724258402362.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_5_5_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_5_5_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_5_5_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|895.4 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-5-5-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_6_2_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_6_2_cnndm_en.md new file mode 100644 index 00000000000000..0af531ca7611a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_6_2_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_6_2_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_6_2_cnndm +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_6_2_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_2_cnndm_en_5.4.2_3.0_1724208383715.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_2_cnndm_en_5.4.2_3.0_1724208383715.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_6_2_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_6_2_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_6_2_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|736.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-6-2-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_6_2_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_6_2_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..f8e3c7bd4d86d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_6_2_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_6_2_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_6_2_cnndm_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_6_2_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_2_cnndm_pipeline_en_5.4.2_3.0_1724208419375.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_2_cnndm_pipeline_en_5.4.2_3.0_1724208419375.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_6_2_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_6_2_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_6_2_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|736.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-6-2-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_cars_descriptions_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_cars_descriptions_en.md new file mode 100644 index 00000000000000..9edf19b4a802ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_cars_descriptions_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_cars_descriptions T5Transformer from fashxp +author: John Snow Labs +name: flan_t5_base_cars_descriptions +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_cars_descriptions` is a English model originally trained by fashxp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_cars_descriptions_en_5.4.2_3.0_1724251622108.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_cars_descriptions_en_5.4.2_3.0_1724251622108.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_cars_descriptions","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_cars_descriptions", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_cars_descriptions| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/fashxp/flan-t5-base-cars-descriptions \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_cars_descriptions_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_cars_descriptions_pipeline_en.md new file mode 100644 index 00000000000000..bb215cf8d6a2b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_cars_descriptions_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_cars_descriptions_pipeline pipeline T5Transformer from fashxp +author: John Snow Labs +name: flan_t5_base_cars_descriptions_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_cars_descriptions_pipeline` is a English model originally trained by fashxp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_cars_descriptions_pipeline_en_5.4.2_3.0_1724251670615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_cars_descriptions_pipeline_en_5.4.2_3.0_1724251670615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_cars_descriptions_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_cars_descriptions_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_cars_descriptions_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/fashxp/flan-t5-base-cars-descriptions + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_coqa_v0_2_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_coqa_v0_2_en.md new file mode 100644 index 00000000000000..a069f164ddcdbf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_coqa_v0_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_coqa_v0_2 T5Transformer from rooftopcoder +author: John Snow Labs +name: flan_t5_base_coqa_v0_2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_coqa_v0_2` is a English model originally trained by rooftopcoder. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_coqa_v0_2_en_5.4.2_3.0_1724269046075.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_coqa_v0_2_en_5.4.2_3.0_1724269046075.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_coqa_v0_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_coqa_v0_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_coqa_v0_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rooftopcoder/flan-t5-base-coqa-V0.2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_coqa_v0_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_coqa_v0_2_pipeline_en.md new file mode 100644 index 00000000000000..f32cfc55ee5d28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_coqa_v0_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_coqa_v0_2_pipeline pipeline T5Transformer from rooftopcoder +author: John Snow Labs +name: flan_t5_base_coqa_v0_2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_coqa_v0_2_pipeline` is a English model originally trained by rooftopcoder. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_coqa_v0_2_pipeline_en_5.4.2_3.0_1724269094562.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_coqa_v0_2_pipeline_en_5.4.2_3.0_1724269094562.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_coqa_v0_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_coqa_v0_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_coqa_v0_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/rooftopcoder/flan-t5-base-coqa-V0.2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_2000_all_loss_ep50_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_2000_all_loss_ep50_en.md new file mode 100644 index 00000000000000..746a0e6f6f60d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_2000_all_loss_ep50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_2000_all_loss_ep50 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_2000_all_loss_ep50 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_2000_all_loss_ep50` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_2000_all_loss_ep50_en_5.4.2_3.0_1724227041917.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_2000_all_loss_ep50_en_5.4.2_3.0_1724227041917.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_2000_all_loss_ep50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_2000_all_loss_ep50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_2000_all_loss_ep50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_2000-all-loss-ep50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline_en.md new file mode 100644 index 00000000000000..ca442354b236cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline_en_5.4.2_3.0_1724227097274.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline_en_5.4.2_3.0_1724227097274.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_2000_all_loss_ep50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_2000-all-loss-ep50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_en.md new file mode 100644 index 00000000000000..7b3e962c7653d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_en_5.4.2_3.0_1724264711428.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_en_5.4.2_3.0_1724264711428.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_40000-all-hint_precision-ep50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline_en.md new file mode 100644 index 00000000000000..443eafcace73a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline_en_5.4.2_3.0_1724264758824.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline_en_5.4.2_3.0_1724264758824.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_40000_all_hint_precision_ep50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_40000-all-hint_precision-ep50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_4000_all_loss_ep50_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_4000_all_loss_ep50_en.md new file mode 100644 index 00000000000000..f0bd53c368739b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_4000_all_loss_ep50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_4000_all_loss_ep50 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_4000_all_loss_ep50 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_4000_all_loss_ep50` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_4000_all_loss_ep50_en_5.4.2_3.0_1724199064429.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_4000_all_loss_ep50_en_5.4.2_3.0_1724199064429.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_4000_all_loss_ep50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_extraction_cnndm_4000_all_loss_ep50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_4000_all_loss_ep50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_4000-all-loss-ep50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline_en.md new file mode 100644 index 00000000000000..58857c16144f04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline_en_5.4.2_3.0_1724199111706.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline_en_5.4.2_3.0_1724199111706.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_extraction_cnndm_4000_all_loss_ep50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-extraction-cnndm_4000-all-loss-ep50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_length_control_token_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_length_control_token_en.md new file mode 100644 index 00000000000000..0056d163ec95c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_length_control_token_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_finetuned_length_control_token T5Transformer from convaise-idp +author: John Snow Labs +name: flan_t5_base_finetuned_length_control_token +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_length_control_token` is a English model originally trained by convaise-idp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_length_control_token_en_5.4.2_3.0_1724208303054.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_length_control_token_en_5.4.2_3.0_1724208303054.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_finetuned_length_control_token","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_finetuned_length_control_token", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_length_control_token| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/convaise-idp/flan-t5-base-finetuned-length_control_token \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_length_control_token_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_length_control_token_pipeline_en.md new file mode 100644 index 00000000000000..8e6077994d0ef7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_length_control_token_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_finetuned_length_control_token_pipeline pipeline T5Transformer from convaise-idp +author: John Snow Labs +name: flan_t5_base_finetuned_length_control_token_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_length_control_token_pipeline` is a English model originally trained by convaise-idp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_length_control_token_pipeline_en_5.4.2_3.0_1724208351777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_length_control_token_pipeline_en_5.4.2_3.0_1724208351777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_finetuned_length_control_token_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_finetuned_length_control_token_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_length_control_token_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/convaise-idp/flan-t5-base-finetuned-length_control_token + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_en.md new file mode 100644 index 00000000000000..83342be3d5f38e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test T5Transformer from thivy +author: John Snow Labs +name: flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test` is a English model originally trained by thivy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_en_5.4.2_3.0_1724217042989.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_en_5.4.2_3.0_1724217042989.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/thivy/flan-t5-base-finetuned-opus_books-en-to-no-test-finetuned-open_subtitles-en-to-no-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline_en.md new file mode 100644 index 00000000000000..7cb92d5b074113 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline pipeline T5Transformer from thivy +author: John Snow Labs +name: flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline` is a English model originally trained by thivy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline_en_5.4.2_3.0_1724217091453.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline_en_5.4.2_3.0_1724217091453.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_opus_books_english_tonga_tonga_islands_norwegian_test_finetuned_open_subtitles_english_tonga_tonga_islands_norwegian_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/thivy/flan-t5-base-finetuned-opus_books-en-to-no-test-finetuned-open_subtitles-en-to-no-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_imdb_text_classification_amitku123_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_imdb_text_classification_amitku123_en.md new file mode 100644 index 00000000000000..123b7c35c5ac5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_imdb_text_classification_amitku123_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_amitku123 T5Transformer from amitku123 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_amitku123 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_amitku123` is a English model originally trained by amitku123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_amitku123_en_5.4.2_3.0_1724229603675.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_amitku123_en_5.4.2_3.0_1724229603675.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_amitku123","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_amitku123", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_amitku123| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/amitku123/flan-t5-base-imdb-text-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_imdb_text_classification_amitku123_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_imdb_text_classification_amitku123_pipeline_en.md new file mode 100644 index 00000000000000..badb525e39b09b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_imdb_text_classification_amitku123_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_amitku123_pipeline pipeline T5Transformer from amitku123 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_amitku123_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_amitku123_pipeline` is a English model originally trained by amitku123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_amitku123_pipeline_en_5.4.2_3.0_1724229652209.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_amitku123_pipeline_en_5.4.2_3.0_1724229652209.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_imdb_text_classification_amitku123_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_imdb_text_classification_amitku123_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_amitku123_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/amitku123/flan-t5-base-imdb-text-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_instructiongen_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_instructiongen_en.md new file mode 100644 index 00000000000000..937425162bcc5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_instructiongen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_instructiongen T5Transformer from pszemraj +author: John Snow Labs +name: flan_t5_base_instructiongen +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_instructiongen` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_instructiongen_en_5.4.2_3.0_1724255721303.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_instructiongen_en_5.4.2_3.0_1724255721303.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_instructiongen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_instructiongen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_instructiongen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pszemraj/flan-t5-base-instructiongen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_instructiongen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_instructiongen_pipeline_en.md new file mode 100644 index 00000000000000..dbe28e0c13c662 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_instructiongen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_instructiongen_pipeline pipeline T5Transformer from pszemraj +author: John Snow Labs +name: flan_t5_base_instructiongen_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_instructiongen_pipeline` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_instructiongen_pipeline_en_5.4.2_3.0_1724255775772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_instructiongen_pipeline_en_5.4.2_3.0_1724255775772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_instructiongen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_instructiongen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_instructiongen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pszemraj/flan-t5-base-instructiongen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_laureanadcastro_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_laureanadcastro_en.md new file mode 100644 index 00000000000000..ede78e4824ad61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_laureanadcastro_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_laureanadcastro T5Transformer from laureanadcastro +author: John Snow Labs +name: flan_t5_base_laureanadcastro +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_laureanadcastro` is a English model originally trained by laureanadcastro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_laureanadcastro_en_5.4.2_3.0_1724281396133.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_laureanadcastro_en_5.4.2_3.0_1724281396133.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_laureanadcastro","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_laureanadcastro", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_laureanadcastro| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/laureanadcastro/flan-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_laureanadcastro_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_laureanadcastro_pipeline_en.md new file mode 100644 index 00000000000000..0cdd67356788c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_laureanadcastro_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_laureanadcastro_pipeline pipeline T5Transformer from laureanadcastro +author: John Snow Labs +name: flan_t5_base_laureanadcastro_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_laureanadcastro_pipeline` is a English model originally trained by laureanadcastro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_laureanadcastro_pipeline_en_5.4.2_3.0_1724281451395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_laureanadcastro_pipeline_en_5.4.2_3.0_1724281451395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_laureanadcastro_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_laureanadcastro_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_laureanadcastro_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/laureanadcastro/flan-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samah_finetuned_flan_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samah_finetuned_flan_en.md new file mode 100644 index 00000000000000..45dce990737328 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samah_finetuned_flan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_samah_finetuned_flan T5Transformer from sama2023 +author: John Snow Labs +name: flan_t5_base_samah_finetuned_flan +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samah_finetuned_flan` is a English model originally trained by sama2023. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samah_finetuned_flan_en_5.4.2_3.0_1724228558667.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samah_finetuned_flan_en_5.4.2_3.0_1724228558667.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_samah_finetuned_flan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_samah_finetuned_flan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samah_finetuned_flan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sama2023/flan-t5-base-samah_finetuned_flan \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samah_finetuned_flan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samah_finetuned_flan_pipeline_en.md new file mode 100644 index 00000000000000..8320cecf981364 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samah_finetuned_flan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_samah_finetuned_flan_pipeline pipeline T5Transformer from sama2023 +author: John Snow Labs +name: flan_t5_base_samah_finetuned_flan_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samah_finetuned_flan_pipeline` is a English model originally trained by sama2023. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samah_finetuned_flan_pipeline_en_5.4.2_3.0_1724228621872.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samah_finetuned_flan_pipeline_en_5.4.2_3.0_1724228621872.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_samah_finetuned_flan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_samah_finetuned_flan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samah_finetuned_flan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sama2023/flan-t5-base-samah_finetuned_flan + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samsum_apekshik_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samsum_apekshik_en.md new file mode 100644 index 00000000000000..2e243fa760ac54 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samsum_apekshik_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_samsum_apekshik T5Transformer from apekshik +author: John Snow Labs +name: flan_t5_base_samsum_apekshik +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_apekshik` is a English model originally trained by apekshik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_apekshik_en_5.4.2_3.0_1724260035084.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_apekshik_en_5.4.2_3.0_1724260035084.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_samsum_apekshik","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_samsum_apekshik", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_apekshik| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/apekshik/flan-t5-base-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samsum_apekshik_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samsum_apekshik_pipeline_en.md new file mode 100644 index 00000000000000..b2b616ee3a8d73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_samsum_apekshik_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_samsum_apekshik_pipeline pipeline T5Transformer from apekshik +author: John Snow Labs +name: flan_t5_base_samsum_apekshik_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_apekshik_pipeline` is a English model originally trained by apekshik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_apekshik_pipeline_en_5.4.2_3.0_1724260083594.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_apekshik_pipeline_en_5.4.2_3.0_1724260083594.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_samsum_apekshik_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_samsum_apekshik_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_apekshik_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/apekshik/flan-t5-base-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_intimacy_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_intimacy_en.md new file mode 100644 index 00000000000000..fd704ab5f99147 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_intimacy_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_tweet_intimacy T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_intimacy +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_intimacy` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_intimacy_en_5.4.2_3.0_1724215047778.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_intimacy_en_5.4.2_3.0_1724215047778.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_tweet_intimacy","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_tweet_intimacy", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_intimacy| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-intimacy \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_intimacy_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_intimacy_pipeline_en.md new file mode 100644 index 00000000000000..93fa6d63f7a978 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_intimacy_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_tweet_intimacy_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_intimacy_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_intimacy_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_intimacy_pipeline_en_5.4.2_3.0_1724215109152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_intimacy_pipeline_en_5.4.2_3.0_1724215109152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_tweet_intimacy_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_tweet_intimacy_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_intimacy_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-intimacy + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_sentiment_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_sentiment_en.md new file mode 100644 index 00000000000000..45ab13feae4e13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_sentiment_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_tweet_sentiment T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_sentiment +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_sentiment` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_sentiment_en_5.4.2_3.0_1724217840809.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_sentiment_en_5.4.2_3.0_1724217840809.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_tweet_sentiment","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_tweet_sentiment", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_sentiment| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-sentiment \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_sentiment_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_sentiment_pipeline_en.md new file mode 100644 index 00000000000000..d1e490a3fb34a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_sentiment_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_tweet_sentiment_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_sentiment_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_sentiment_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_sentiment_pipeline_en_5.4.2_3.0_1724217893787.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_sentiment_pipeline_en_5.4.2_3.0_1724217893787.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_tweet_sentiment_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_tweet_sentiment_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_sentiment_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-sentiment + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_topic_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_topic_en.md new file mode 100644 index 00000000000000..507d2ab90620a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_topic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_tweet_topic T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_topic +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_topic` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_topic_en_5.4.2_3.0_1724257672606.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_topic_en_5.4.2_3.0_1724257672606.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_tweet_topic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_tweet_topic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_topic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-topic \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_topic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_topic_pipeline_en.md new file mode 100644 index 00000000000000..a0478917e832db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_base_tweet_topic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_tweet_topic_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tweet_topic_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tweet_topic_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_topic_pipeline_en_5.4.2_3.0_1724257719779.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tweet_topic_pipeline_en_5.4.2_3.0_1724257719779.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_tweet_topic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_tweet_topic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tweet_topic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tweet-topic + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_booksum_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_booksum_en.md new file mode 100644 index 00000000000000..ca6eb9d7e6e88a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_booksum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_booksum T5Transformer from logits +author: John Snow Labs +name: flan_t5_booksum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_booksum` is a English model originally trained by logits. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_booksum_en_5.4.2_3.0_1724247986556.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_booksum_en_5.4.2_3.0_1724247986556.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_booksum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_booksum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_booksum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/logits/flan-t5-booksum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_booksum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_booksum_pipeline_en.md new file mode 100644 index 00000000000000..6a1ad194df669c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_booksum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_booksum_pipeline pipeline T5Transformer from logits +author: John Snow Labs +name: flan_t5_booksum_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_booksum_pipeline` is a English model originally trained by logits. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_booksum_pipeline_en_5.4.2_3.0_1724248135183.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_booksum_pipeline_en_5.4.2_3.0_1724248135183.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_booksum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_booksum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_booksum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/logits/flan-t5-booksum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_aio_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_aio_en.md new file mode 100644 index 00000000000000..6414db6af53322 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_aio_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_aio T5Transformer from KarthikSaran +author: John Snow Labs +name: flan_t5_large_aio +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_aio` is a English model originally trained by KarthikSaran. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_aio_en_5.4.2_3.0_1724208914090.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_aio_en_5.4.2_3.0_1724208914090.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_aio","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_aio", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_aio| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/KarthikSaran/flan-t5-large-aio \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_aio_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_aio_pipeline_en.md new file mode 100644 index 00000000000000..b0acaffddeec8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_aio_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_aio_pipeline pipeline T5Transformer from KarthikSaran +author: John Snow Labs +name: flan_t5_large_aio_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_aio_pipeline` is a English model originally trained by KarthikSaran. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_aio_pipeline_en_5.4.2_3.0_1724209050646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_aio_pipeline_en_5.4.2_3.0_1724209050646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_aio_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_aio_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_aio_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/KarthikSaran/flan-t5-large-aio + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_clang8_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_clang8_e8_b16_en.md new file mode 100644 index 00000000000000..45dc4e7176940c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_clang8_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_clang8_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_large_clang8_e8_b16 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_clang8_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_clang8_e8_b16_en_5.4.2_3.0_1724205240577.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_clang8_e8_b16_en_5.4.2_3.0_1724205240577.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_clang8_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_clang8_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_clang8_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-large-clang8-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_clang8_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_clang8_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..ea5da2fcbcdb3a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_clang8_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_clang8_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_large_clang8_e8_b16_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_clang8_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_clang8_e8_b16_pipeline_en_5.4.2_3.0_1724205379796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_clang8_e8_b16_pipeline_en_5.4.2_3.0_1724205379796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_clang8_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_clang8_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_clang8_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-large-clang8-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_en.md new file mode 100644 index 00000000000000..9d75db1de34d43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_en_5.4.2_3.0_1724281446264.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_en_5.4.2_3.0_1724281446264.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_800-ep8-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..9895b6755afcc8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline_en_5.4.2_3.0_1724281599018.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline_en_5.4.2_3.0_1724281599018.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_800_ep8_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_800-ep8-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_en.md new file mode 100644 index 00000000000000..322f801da4273b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_en_5.4.2_3.0_1724235865621.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_en_5.4.2_3.0_1724235865621.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_80-ep50-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..7723c9aed5274a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline_en_5.4.2_3.0_1724235998216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline_en_5.4.2_3.0_1724235998216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_80_ep50_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_80-ep50-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extract_issues_and_suggestions_2_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extract_issues_and_suggestions_2_en.md new file mode 100644 index 00000000000000..ee16b312c6c2ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extract_issues_and_suggestions_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extract_issues_and_suggestions_2 T5Transformer from SachinPatel248 +author: John Snow Labs +name: flan_t5_large_extract_issues_and_suggestions_2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extract_issues_and_suggestions_2` is a English model originally trained by SachinPatel248. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extract_issues_and_suggestions_2_en_5.4.2_3.0_1724212184831.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extract_issues_and_suggestions_2_en_5.4.2_3.0_1724212184831.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extract_issues_and_suggestions_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extract_issues_and_suggestions_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extract_issues_and_suggestions_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/SachinPatel248/flan-t5-large-extract-issues-and-suggestions_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extract_issues_and_suggestions_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extract_issues_and_suggestions_2_pipeline_en.md new file mode 100644 index 00000000000000..1cd649591febb9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extract_issues_and_suggestions_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extract_issues_and_suggestions_2_pipeline pipeline T5Transformer from SachinPatel248 +author: John Snow Labs +name: flan_t5_large_extract_issues_and_suggestions_2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extract_issues_and_suggestions_2_pipeline` is a English model originally trained by SachinPatel248. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extract_issues_and_suggestions_2_pipeline_en_5.4.2_3.0_1724212320498.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extract_issues_and_suggestions_2_pipeline_en_5.4.2_3.0_1724212320498.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extract_issues_and_suggestions_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extract_issues_and_suggestions_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extract_issues_and_suggestions_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/SachinPatel248/flan-t5-large-extract-issues-and-suggestions_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extraction_cnndm_10000_all_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extraction_cnndm_10000_all_en.md new file mode 100644 index 00000000000000..c72d580a9dde3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extraction_cnndm_10000_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_10000_all T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_10000_all +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_10000_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_10000_all_en_5.4.2_3.0_1724276256643.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_10000_all_en_5.4.2_3.0_1724276256643.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_10000_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_cnndm_10000_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_10000_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_10000-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extraction_cnndm_10000_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extraction_cnndm_10000_all_pipeline_en.md new file mode 100644 index 00000000000000..5ff67adbc35aa1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_extraction_cnndm_10000_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_cnndm_10000_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_cnndm_10000_all_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_cnndm_10000_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_10000_all_pipeline_en_5.4.2_3.0_1724276398929.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_cnndm_10000_all_pipeline_en_5.4.2_3.0_1724276398929.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_cnndm_10000_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_cnndm_10000_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_cnndm_10000_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-cnndm_10000-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_squad_ae_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_squad_ae_pipeline_en.md new file mode 100644 index 00000000000000..01fbfec1a8de97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_large_squad_ae_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_squad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: flan_t5_large_squad_ae_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_squad_ae_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_squad_ae_pipeline_en_5.4.2_3.0_1724272525176.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_squad_ae_pipeline_en_5.4.2_3.0_1724272525176.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_squad_ae_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_squad_ae_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_squad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/lmqg/flan-t5-large-squad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_qg_lq_tarek_test_lqq_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_qg_lq_tarek_test_lqq_en.md new file mode 100644 index 00000000000000..8d1c945fe644c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_qg_lq_tarek_test_lqq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_qg_lq_tarek_test_lqq T5Transformer from tarek23 +author: John Snow Labs +name: flan_t5_qg_lq_tarek_test_lqq +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_qg_lq_tarek_test_lqq` is a English model originally trained by tarek23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_qg_lq_tarek_test_lqq_en_5.4.2_3.0_1724207503174.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_qg_lq_tarek_test_lqq_en_5.4.2_3.0_1724207503174.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_qg_lq_tarek_test_lqq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_qg_lq_tarek_test_lqq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_qg_lq_tarek_test_lqq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/tarek23/flan-t5-qg-LQ-tarek-test-LQQ \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_qg_lq_tarek_test_lqq_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_qg_lq_tarek_test_lqq_pipeline_en.md new file mode 100644 index 00000000000000..4aac374b0348db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_qg_lq_tarek_test_lqq_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_qg_lq_tarek_test_lqq_pipeline pipeline T5Transformer from tarek23 +author: John Snow Labs +name: flan_t5_qg_lq_tarek_test_lqq_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_qg_lq_tarek_test_lqq_pipeline` is a English model originally trained by tarek23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_qg_lq_tarek_test_lqq_pipeline_en_5.4.2_3.0_1724207519555.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_qg_lq_tarek_test_lqq_pipeline_en_5.4.2_3.0_1724207519555.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_qg_lq_tarek_test_lqq_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_qg_lq_tarek_test_lqq_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_qg_lq_tarek_test_lqq_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/tarek23/flan-t5-qg-LQ-tarek-test-LQQ + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_retacred_kongo_w_context_var_len_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_retacred_kongo_w_context_var_len_small_finetuned_en.md new file mode 100644 index 00000000000000..c3495d9e207007 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_retacred_kongo_w_context_var_len_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_w_context_var_len_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_w_context_var_len_small_finetuned +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_w_context_var_len_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_w_context_var_len_small_finetuned_en_5.4.2_3.0_1724232276228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_w_context_var_len_small_finetuned_en_5.4.2_3.0_1724232276228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_w_context_var_len_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_w_context_var_len_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_w_context_var_len_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-w-context-var-len-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..372e70263ab33d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline_en_5.4.2_3.0_1724232293274.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline_en_5.4.2_3.0_1724232293274.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_w_context_var_len_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-w-context-var-len-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_6_4_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_6_4_cnndm_en.md new file mode 100644 index 00000000000000..22acfb805b2d63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_6_4_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_6_4_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_4_cnndm +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_4_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_4_cnndm_en_5.4.2_3.0_1724278092981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_4_cnndm_en_5.4.2_3.0_1724278092981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_6_4_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_6_4_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_4_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.4 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-4-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_6_4_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_6_4_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..06b25018b84922 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_6_4_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_6_4_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_4_cnndm_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_4_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_4_cnndm_pipeline_en_5.4.2_3.0_1724278107885.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_4_cnndm_pipeline_en_5.4.2_3.0_1724278107885.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_6_4_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_6_4_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_4_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.4 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-4-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_en.md new file mode 100644 index 00000000000000..4158fd6e66b442 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only T5Transformer from IsaacBot +author: John Snow Labs +name: flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only` is a English model originally trained by IsaacBot. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_en_5.4.2_3.0_1724220261355.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_en_5.4.2_3.0_1724220261355.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/IsaacBot/flan-t5-small-botco_QA_no_context-finetuned-question-generation-context-only \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline_en.md new file mode 100644 index 00000000000000..d8a3d6212c0c62 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline pipeline T5Transformer from IsaacBot +author: John Snow Labs +name: flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline` is a English model originally trained by IsaacBot. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline_en_5.4.2_3.0_1724220279099.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline_en_5.4.2_3.0_1724220279099.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_botco_qa_norwegian_context_finetuned_question_generation_context_only_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/IsaacBot/flan-t5-small-botco_QA_no_context-finetuned-question-generation-context-only + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_en.md new file mode 100644 index 00000000000000..19e25f5d13ae33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_finetuned_english_tonga_tonga_islands_romanian T5Transformer from spdenisov +author: John Snow Labs +name: flan_t5_small_finetuned_english_tonga_tonga_islands_romanian +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_english_tonga_tonga_islands_romanian` is a English model originally trained by spdenisov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724236344517.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724236344517.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_finetuned_english_tonga_tonga_islands_romanian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_finetuned_english_tonga_tonga_islands_romanian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_english_tonga_tonga_islands_romanian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/spdenisov/flan-t5-small-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md new file mode 100644 index 00000000000000..34a308a783a0a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline pipeline T5Transformer from spdenisov +author: John Snow Labs +name: flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline` is a English model originally trained by spdenisov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724236361175.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724236361175.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_english_tonga_tonga_islands_romanian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/spdenisov/flan-t5-small-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_query_expansion_merged_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_query_expansion_merged_en.md new file mode 100644 index 00000000000000..1f07a56a008bf0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_query_expansion_merged_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_query_expansion_merged T5Transformer from lapp0 +author: John Snow Labs +name: flan_t5_small_query_expansion_merged +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_query_expansion_merged` is a English model originally trained by lapp0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_query_expansion_merged_en_5.4.2_3.0_1724260080984.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_query_expansion_merged_en_5.4.2_3.0_1724260080984.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_query_expansion_merged","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_query_expansion_merged", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_query_expansion_merged| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/lapp0/flan-t5-small-query-expansion-merged \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_query_expansion_merged_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_query_expansion_merged_pipeline_en.md new file mode 100644 index 00000000000000..965499ef4d64e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_query_expansion_merged_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_query_expansion_merged_pipeline pipeline T5Transformer from lapp0 +author: John Snow Labs +name: flan_t5_small_query_expansion_merged_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_query_expansion_merged_pipeline` is a English model originally trained by lapp0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_query_expansion_merged_pipeline_en_5.4.2_3.0_1724260098505.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_query_expansion_merged_pipeline_en_5.4.2_3.0_1724260098505.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_query_expansion_merged_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_query_expansion_merged_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_query_expansion_merged_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/lapp0/flan-t5-small-query-expansion-merged + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_elenaaaaaaa_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_elenaaaaaaa_en.md new file mode 100644 index 00000000000000..92d40b88f06c7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_elenaaaaaaa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_elenaaaaaaa T5Transformer from ElEnAaaaaaa +author: John Snow Labs +name: flan_t5_small_samsum_elenaaaaaaa +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_elenaaaaaaa` is a English model originally trained by ElEnAaaaaaa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_elenaaaaaaa_en_5.4.2_3.0_1724280315152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_elenaaaaaaa_en_5.4.2_3.0_1724280315152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_elenaaaaaaa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_elenaaaaaaa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_elenaaaaaaa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/ElEnAaaaaaa/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_elenaaaaaaa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_elenaaaaaaa_pipeline_en.md new file mode 100644 index 00000000000000..dedc6bca29f29f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_elenaaaaaaa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_elenaaaaaaa_pipeline pipeline T5Transformer from ElEnAaaaaaa +author: John Snow Labs +name: flan_t5_small_samsum_elenaaaaaaa_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_elenaaaaaaa_pipeline` is a English model originally trained by ElEnAaaaaaa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_elenaaaaaaa_pipeline_en_5.4.2_3.0_1724280332073.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_elenaaaaaaa_pipeline_en_5.4.2_3.0_1724280332073.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_elenaaaaaaa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_elenaaaaaaa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_elenaaaaaaa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/ElEnAaaaaaa/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_hanaamiri_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_hanaamiri_en.md new file mode 100644 index 00000000000000..801909e7deab38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_hanaamiri_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_hanaamiri T5Transformer from Hanaamiri +author: John Snow Labs +name: flan_t5_small_samsum_hanaamiri +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_hanaamiri` is a English model originally trained by Hanaamiri. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_hanaamiri_en_5.4.2_3.0_1724284237499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_hanaamiri_en_5.4.2_3.0_1724284237499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_hanaamiri","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_hanaamiri", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_hanaamiri| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Hanaamiri/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_hanaamiri_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_hanaamiri_pipeline_en.md new file mode 100644 index 00000000000000..6ead3060e949ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flan_t5_small_samsum_hanaamiri_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_hanaamiri_pipeline pipeline T5Transformer from Hanaamiri +author: John Snow Labs +name: flan_t5_small_samsum_hanaamiri_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_hanaamiri_pipeline` is a English model originally trained by Hanaamiri. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_hanaamiri_pipeline_en_5.4.2_3.0_1724284254631.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_hanaamiri_pipeline_en_5.4.2_3.0_1724284254631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_hanaamiri_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_hanaamiri_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_hanaamiri_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Hanaamiri/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flant5_base_tuquyennnn_en.md b/docs/_posts/ahmedlone127/2024-08-21-flant5_base_tuquyennnn_en.md new file mode 100644 index 00000000000000..d1d538dcd69f2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flant5_base_tuquyennnn_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5_base_tuquyennnn T5Transformer from tuquyennnn +author: John Snow Labs +name: flant5_base_tuquyennnn +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_base_tuquyennnn` is a English model originally trained by tuquyennnn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_base_tuquyennnn_en_5.4.2_3.0_1724235226121.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_base_tuquyennnn_en_5.4.2_3.0_1724235226121.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_base_tuquyennnn","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_base_tuquyennnn", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_base_tuquyennnn| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/tuquyennnn/flant5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flant5_base_tuquyennnn_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flant5_base_tuquyennnn_pipeline_en.md new file mode 100644 index 00000000000000..e16d572cd3e280 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flant5_base_tuquyennnn_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5_base_tuquyennnn_pipeline pipeline T5Transformer from tuquyennnn +author: John Snow Labs +name: flant5_base_tuquyennnn_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_base_tuquyennnn_pipeline` is a English model originally trained by tuquyennnn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_base_tuquyennnn_pipeline_en_5.4.2_3.0_1724235228706.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_base_tuquyennnn_pipeline_en_5.4.2_3.0_1724235228706.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_base_tuquyennnn_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_base_tuquyennnn_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_base_tuquyennnn_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/tuquyennnn/flant5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flant5_mwpsolver_en.md b/docs/_posts/ahmedlone127/2024-08-21-flant5_mwpsolver_en.md new file mode 100644 index 00000000000000..6b693674cfeec0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flant5_mwpsolver_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5_mwpsolver T5Transformer from apoorv627g +author: John Snow Labs +name: flant5_mwpsolver +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_mwpsolver` is a English model originally trained by apoorv627g. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_mwpsolver_en_5.4.2_3.0_1724269164228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_mwpsolver_en_5.4.2_3.0_1724269164228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_mwpsolver","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_mwpsolver", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_mwpsolver| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/apoorv627g/FlanT5_MWPSolver \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flant5_mwpsolver_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flant5_mwpsolver_pipeline_en.md new file mode 100644 index 00000000000000..6fbe30b26dad38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flant5_mwpsolver_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5_mwpsolver_pipeline pipeline T5Transformer from apoorv627g +author: John Snow Labs +name: flant5_mwpsolver_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_mwpsolver_pipeline` is a English model originally trained by apoorv627g. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_mwpsolver_pipeline_en_5.4.2_3.0_1724269214052.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_mwpsolver_pipeline_en_5.4.2_3.0_1724269214052.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_mwpsolver_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_mwpsolver_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_mwpsolver_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/apoorv627g/FlanT5_MWPSolver + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flanwithanswer_en.md b/docs/_posts/ahmedlone127/2024-08-21-flanwithanswer_en.md new file mode 100644 index 00000000000000..119682e4edd24b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flanwithanswer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flanwithanswer T5Transformer from erbacher +author: John Snow Labs +name: flanwithanswer +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flanwithanswer` is a English model originally trained by erbacher. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flanwithanswer_en_5.4.2_3.0_1724245626054.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flanwithanswer_en_5.4.2_3.0_1724245626054.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flanwithanswer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flanwithanswer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flanwithanswer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/erbacher/flanwithanswer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-flanwithanswer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-flanwithanswer_pipeline_en.md new file mode 100644 index 00000000000000..be45a4d65f1cf4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-flanwithanswer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flanwithanswer_pipeline pipeline T5Transformer from erbacher +author: John Snow Labs +name: flanwithanswer_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flanwithanswer_pipeline` is a English model originally trained by erbacher. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flanwithanswer_pipeline_en_5.4.2_3.0_1724245763129.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flanwithanswer_pipeline_en_5.4.2_3.0_1724245763129.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flanwithanswer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flanwithanswer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flanwithanswer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/erbacher/flanwithanswer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ft_aeroqa_1hop_aviationcorpus_20_en.md b/docs/_posts/ahmedlone127/2024-08-21-ft_aeroqa_1hop_aviationcorpus_20_en.md new file mode 100644 index 00000000000000..aa6518b8547cb1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ft_aeroqa_1hop_aviationcorpus_20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_aeroqa_1hop_aviationcorpus_20 T5Transformer from sakharamg +author: John Snow Labs +name: ft_aeroqa_1hop_aviationcorpus_20 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aeroqa_1hop_aviationcorpus_20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_aviationcorpus_20_en_5.4.2_3.0_1724243509047.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_aviationcorpus_20_en_5.4.2_3.0_1724243509047.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_aeroqa_1hop_aviationcorpus_20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_aeroqa_1hop_aviationcorpus_20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aeroqa_1hop_aviationcorpus_20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aeroqa_1hop_aviationcorpus_20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ft_aeroqa_1hop_aviationcorpus_20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-ft_aeroqa_1hop_aviationcorpus_20_pipeline_en.md new file mode 100644 index 00000000000000..fc75a3624d66e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ft_aeroqa_1hop_aviationcorpus_20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft_aeroqa_1hop_aviationcorpus_20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: ft_aeroqa_1hop_aviationcorpus_20_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aeroqa_1hop_aviationcorpus_20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_aviationcorpus_20_pipeline_en_5.4.2_3.0_1724243677748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_aviationcorpus_20_pipeline_en_5.4.2_3.0_1724243677748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft_aeroqa_1hop_aviationcorpus_20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft_aeroqa_1hop_aviationcorpus_20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aeroqa_1hop_aviationcorpus_20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aeroqa_1hop_aviationcorpus_20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-genchal_2022_nigula_en.md b/docs/_posts/ahmedlone127/2024-08-21-genchal_2022_nigula_en.md new file mode 100644 index 00000000000000..9ba88519a677e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-genchal_2022_nigula_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English genchal_2022_nigula T5Transformer from s-nlp +author: John Snow Labs +name: genchal_2022_nigula +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`genchal_2022_nigula` is a English model originally trained by s-nlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/genchal_2022_nigula_en_5.4.2_3.0_1724230488269.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/genchal_2022_nigula_en_5.4.2_3.0_1724230488269.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("genchal_2022_nigula","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("genchal_2022_nigula", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|genchal_2022_nigula| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/s-nlp/GenChal_2022_nigula \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-genchal_2022_nigula_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-genchal_2022_nigula_pipeline_en.md new file mode 100644 index 00000000000000..7f9448f0b71e6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-genchal_2022_nigula_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English genchal_2022_nigula_pipeline pipeline T5Transformer from s-nlp +author: John Snow Labs +name: genchal_2022_nigula_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`genchal_2022_nigula_pipeline` is a English model originally trained by s-nlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/genchal_2022_nigula_pipeline_en_5.4.2_3.0_1724230630781.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/genchal_2022_nigula_pipeline_en_5.4.2_3.0_1724230630781.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("genchal_2022_nigula_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("genchal_2022_nigula_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|genchal_2022_nigula_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/s-nlp/GenChal_2022_nigula + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-googleflan_t5_base_laptop14_1907_en.md b/docs/_posts/ahmedlone127/2024-08-21-googleflan_t5_base_laptop14_1907_en.md new file mode 100644 index 00000000000000..df90d2305587b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-googleflan_t5_base_laptop14_1907_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English googleflan_t5_base_laptop14_1907 T5Transformer from baohl00 +author: John Snow Labs +name: googleflan_t5_base_laptop14_1907 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`googleflan_t5_base_laptop14_1907` is a English model originally trained by baohl00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/googleflan_t5_base_laptop14_1907_en_5.4.2_3.0_1724268071178.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/googleflan_t5_base_laptop14_1907_en_5.4.2_3.0_1724268071178.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("googleflan_t5_base_laptop14_1907","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("googleflan_t5_base_laptop14_1907", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|googleflan_t5_base_laptop14_1907| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/baohl00/googleflan-t5-base-laptop14-1907 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-googleflan_t5_base_laptop14_1907_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-googleflan_t5_base_laptop14_1907_pipeline_en.md new file mode 100644 index 00000000000000..de60d0de09dc32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-googleflan_t5_base_laptop14_1907_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English googleflan_t5_base_laptop14_1907_pipeline pipeline T5Transformer from baohl00 +author: John Snow Labs +name: googleflan_t5_base_laptop14_1907_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`googleflan_t5_base_laptop14_1907_pipeline` is a English model originally trained by baohl00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/googleflan_t5_base_laptop14_1907_pipeline_en_5.4.2_3.0_1724268119210.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/googleflan_t5_base_laptop14_1907_pipeline_en_5.4.2_3.0_1724268119210.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("googleflan_t5_base_laptop14_1907_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("googleflan_t5_base_laptop14_1907_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|googleflan_t5_base_laptop14_1907_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/baohl00/googleflan-t5-base-laptop14-1907 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-grammar_model_wmt460_en.md b/docs/_posts/ahmedlone127/2024-08-21-grammar_model_wmt460_en.md new file mode 100644 index 00000000000000..00da209d15414e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-grammar_model_wmt460_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammar_model_wmt460 T5Transformer from mika5883 +author: John Snow Labs +name: grammar_model_wmt460 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_model_wmt460` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_model_wmt460_en_5.4.2_3.0_1724245834617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_model_wmt460_en_5.4.2_3.0_1724245834617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammar_model_wmt460","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammar_model_wmt460", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_model_wmt460| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/grammar_model_wmt460 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-grammar_model_wmt460_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-grammar_model_wmt460_pipeline_en.md new file mode 100644 index 00000000000000..925946dd05649b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-grammar_model_wmt460_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammar_model_wmt460_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: grammar_model_wmt460_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_model_wmt460_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_model_wmt460_pipeline_en_5.4.2_3.0_1724245889480.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_model_wmt460_pipeline_en_5.4.2_3.0_1724245889480.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammar_model_wmt460_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammar_model_wmt460_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_model_wmt460_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/grammar_model_wmt460 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-grammar_synthesis_large_en.md b/docs/_posts/ahmedlone127/2024-08-21-grammar_synthesis_large_en.md new file mode 100644 index 00000000000000..cace9f4a6f4b3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-grammar_synthesis_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammar_synthesis_large T5Transformer from pszemraj +author: John Snow Labs +name: grammar_synthesis_large +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_synthesis_large` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_synthesis_large_en_5.4.2_3.0_1724215228021.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_synthesis_large_en_5.4.2_3.0_1724215228021.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammar_synthesis_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammar_synthesis_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_synthesis_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/pszemraj/grammar-synthesis-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-grammar_synthesis_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-grammar_synthesis_large_pipeline_en.md new file mode 100644 index 00000000000000..2e214674f4ec63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-grammar_synthesis_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammar_synthesis_large_pipeline pipeline T5Transformer from pszemraj +author: John Snow Labs +name: grammar_synthesis_large_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammar_synthesis_large_pipeline` is a English model originally trained by pszemraj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammar_synthesis_large_pipeline_en_5.4.2_3.0_1724215384190.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammar_synthesis_large_pipeline_en_5.4.2_3.0_1724215384190.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammar_synthesis_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammar_synthesis_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammar_synthesis_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/pszemraj/grammar-synthesis-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-grammerchecking_en.md b/docs/_posts/ahmedlone127/2024-08-21-grammerchecking_en.md new file mode 100644 index 00000000000000..4d4d10a48be6cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-grammerchecking_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English grammerchecking T5Transformer from rabiyulfahim +author: John Snow Labs +name: grammerchecking +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammerchecking` is a English model originally trained by rabiyulfahim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammerchecking_en_5.4.2_3.0_1724246583304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammerchecking_en_5.4.2_3.0_1724246583304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("grammerchecking","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("grammerchecking", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammerchecking| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|985.3 MB| + +## References + +https://huggingface.co/rabiyulfahim/grammerchecking \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-grammerchecking_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-grammerchecking_pipeline_en.md new file mode 100644 index 00000000000000..a84076e2552f59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-grammerchecking_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English grammerchecking_pipeline pipeline T5Transformer from rabiyulfahim +author: John Snow Labs +name: grammerchecking_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`grammerchecking_pipeline` is a English model originally trained by rabiyulfahim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/grammerchecking_pipeline_en_5.4.2_3.0_1724246639149.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/grammerchecking_pipeline_en_5.4.2_3.0_1724246639149.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("grammerchecking_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("grammerchecking_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|grammerchecking_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|985.3 MB| + +## References + +https://huggingface.co/rabiyulfahim/grammerchecking + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-greek_mt5_4ep_384_el.md b/docs/_posts/ahmedlone127/2024-08-21-greek_mt5_4ep_384_el.md new file mode 100644 index 00000000000000..b67a74a8fd93df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-greek_mt5_4ep_384_el.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Modern Greek (1453-) greek_mt5_4ep_384 T5Transformer from chaido13 +author: John Snow Labs +name: greek_mt5_4ep_384 +date: 2024-08-21 +tags: [el, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: el +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`greek_mt5_4ep_384` is a Modern Greek (1453-) model originally trained by chaido13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/greek_mt5_4ep_384_el_5.4.2_3.0_1724282677495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/greek_mt5_4ep_384_el_5.4.2_3.0_1724282677495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("greek_mt5_4ep_384","el") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("greek_mt5_4ep_384", "el") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|greek_mt5_4ep_384| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|el| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chaido13/greek-mt5-4ep-384 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-greek_mt5_4ep_384_pipeline_el.md b/docs/_posts/ahmedlone127/2024-08-21-greek_mt5_4ep_384_pipeline_el.md new file mode 100644 index 00000000000000..911dd1fdb4e43e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-greek_mt5_4ep_384_pipeline_el.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Modern Greek (1453-) greek_mt5_4ep_384_pipeline pipeline T5Transformer from chaido13 +author: John Snow Labs +name: greek_mt5_4ep_384_pipeline +date: 2024-08-21 +tags: [el, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: el +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`greek_mt5_4ep_384_pipeline` is a Modern Greek (1453-) model originally trained by chaido13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/greek_mt5_4ep_384_pipeline_el_5.4.2_3.0_1724282953462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/greek_mt5_4ep_384_pipeline_el_5.4.2_3.0_1724282953462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("greek_mt5_4ep_384_pipeline", lang = "el") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("greek_mt5_4ep_384_pipeline", lang = "el") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|greek_mt5_4ep_384_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|el| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chaido13/greek-mt5-4ep-384 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-homeschema_3_qa_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-21-homeschema_3_qa_finetuned_en.md new file mode 100644 index 00000000000000..69324d4bb310ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-homeschema_3_qa_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English homeschema_3_qa_finetuned T5Transformer from elinaparajuli +author: John Snow Labs +name: homeschema_3_qa_finetuned +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`homeschema_3_qa_finetuned` is a English model originally trained by elinaparajuli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/homeschema_3_qa_finetuned_en_5.4.2_3.0_1724247148093.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/homeschema_3_qa_finetuned_en_5.4.2_3.0_1724247148093.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("homeschema_3_qa_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("homeschema_3_qa_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|homeschema_3_qa_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/elinaparajuli/HomeSchema_3_QA-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-homeschema_3_qa_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-homeschema_3_qa_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..cc6b16fbf62359 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-homeschema_3_qa_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English homeschema_3_qa_finetuned_pipeline pipeline T5Transformer from elinaparajuli +author: John Snow Labs +name: homeschema_3_qa_finetuned_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`homeschema_3_qa_finetuned_pipeline` is a English model originally trained by elinaparajuli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/homeschema_3_qa_finetuned_pipeline_en_5.4.2_3.0_1724247196428.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/homeschema_3_qa_finetuned_pipeline_en_5.4.2_3.0_1724247196428.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("homeschema_3_qa_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("homeschema_3_qa_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|homeschema_3_qa_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/elinaparajuli/HomeSchema_3_QA-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-house_galician_t5_small_21_en.md b/docs/_posts/ahmedlone127/2024-08-21-house_galician_t5_small_21_en.md new file mode 100644 index 00000000000000..cd708a015467e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-house_galician_t5_small_21_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English house_galician_t5_small_21 T5Transformer from neal61 +author: John Snow Labs +name: house_galician_t5_small_21 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`house_galician_t5_small_21` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/house_galician_t5_small_21_en_5.4.2_3.0_1724261914464.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/house_galician_t5_small_21_en_5.4.2_3.0_1724261914464.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("house_galician_t5_small_21","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("house_galician_t5_small_21", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|house_galician_t5_small_21| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.5 MB| + +## References + +https://huggingface.co/neal61/house-gl-t5-small-21 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-house_galician_t5_small_21_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-house_galician_t5_small_21_pipeline_en.md new file mode 100644 index 00000000000000..5283f7555828d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-house_galician_t5_small_21_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English house_galician_t5_small_21_pipeline pipeline T5Transformer from neal61 +author: John Snow Labs +name: house_galician_t5_small_21_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`house_galician_t5_small_21_pipeline` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/house_galician_t5_small_21_pipeline_en_5.4.2_3.0_1724261932263.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/house_galician_t5_small_21_pipeline_en_5.4.2_3.0_1724261932263.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("house_galician_t5_small_21_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("house_galician_t5_small_21_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|house_galician_t5_small_21_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.5 MB| + +## References + +https://huggingface.co/neal61/house-gl-t5-small-21 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-it5_efficient_small_el32_formal_tonga_tonga_islands_informal_it.md b/docs/_posts/ahmedlone127/2024-08-21-it5_efficient_small_el32_formal_tonga_tonga_islands_informal_it.md new file mode 100644 index 00000000000000..d2d731ca227bac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-it5_efficient_small_el32_formal_tonga_tonga_islands_informal_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian it5_efficient_small_el32_formal_tonga_tonga_islands_informal T5Transformer from gsarti +author: John Snow Labs +name: it5_efficient_small_el32_formal_tonga_tonga_islands_informal +date: 2024-08-21 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`it5_efficient_small_el32_formal_tonga_tonga_islands_informal` is a Italian model originally trained by gsarti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_formal_tonga_tonga_islands_informal_it_5.4.2_3.0_1724220728820.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_formal_tonga_tonga_islands_informal_it_5.4.2_3.0_1724220728820.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("it5_efficient_small_el32_formal_tonga_tonga_islands_informal","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("it5_efficient_small_el32_formal_tonga_tonga_islands_informal", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|it5_efficient_small_el32_formal_tonga_tonga_islands_informal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|654.4 MB| + +## References + +https://huggingface.co/gsarti/it5-efficient-small-el32-formal-to-informal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-21-it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline_it.md new file mode 100644 index 00000000000000..f815a3fce8636c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline pipeline T5Transformer from gsarti +author: John Snow Labs +name: it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline +date: 2024-08-21 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline` is a Italian model originally trained by gsarti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline_it_5.4.2_3.0_1724220760933.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline_it_5.4.2_3.0_1724220760933.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|it5_efficient_small_el32_formal_tonga_tonga_islands_informal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|654.4 MB| + +## References + +https://huggingface.co/gsarti/it5-efficient-small-el32-formal-to-informal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-japanese_t5_base_summary_en.md b/docs/_posts/ahmedlone127/2024-08-21-japanese_t5_base_summary_en.md new file mode 100644 index 00000000000000..e326c1cf55cee4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-japanese_t5_base_summary_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English japanese_t5_base_summary T5Transformer from Zolyer +author: John Snow Labs +name: japanese_t5_base_summary +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`japanese_t5_base_summary` is a English model originally trained by Zolyer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/japanese_t5_base_summary_en_5.4.2_3.0_1724211570510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/japanese_t5_base_summary_en_5.4.2_3.0_1724211570510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("japanese_t5_base_summary","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("japanese_t5_base_summary", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|japanese_t5_base_summary| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zolyer/ja-t5-base-summary \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-japanese_t5_base_summary_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-japanese_t5_base_summary_pipeline_en.md new file mode 100644 index 00000000000000..d6477e9503a926 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-japanese_t5_base_summary_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English japanese_t5_base_summary_pipeline pipeline T5Transformer from Zolyer +author: John Snow Labs +name: japanese_t5_base_summary_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`japanese_t5_base_summary_pipeline` is a English model originally trained by Zolyer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/japanese_t5_base_summary_pipeline_en_5.4.2_3.0_1724211621273.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/japanese_t5_base_summary_pipeline_en_5.4.2_3.0_1724211621273.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("japanese_t5_base_summary_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("japanese_t5_base_summary_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|japanese_t5_base_summary_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zolyer/ja-t5-base-summary + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-k2t_3_two_words_msrvtt_lr_0_0001_en.md b/docs/_posts/ahmedlone127/2024-08-21-k2t_3_two_words_msrvtt_lr_0_0001_en.md new file mode 100644 index 00000000000000..373a33c0305d8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-k2t_3_two_words_msrvtt_lr_0_0001_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_3_two_words_msrvtt_lr_0_0001 T5Transformer from taewhan +author: John Snow Labs +name: k2t_3_two_words_msrvtt_lr_0_0001 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_3_two_words_msrvtt_lr_0_0001` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_3_two_words_msrvtt_lr_0_0001_en_5.4.2_3.0_1724279423626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_3_two_words_msrvtt_lr_0_0001_en_5.4.2_3.0_1724279423626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_3_two_words_msrvtt_lr_0_0001","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_3_two_words_msrvtt_lr_0_0001", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_3_two_words_msrvtt_lr_0_0001| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.3 MB| + +## References + +https://huggingface.co/taewhan/k2t-3_two_words_msrvtt_lr_0.0001 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-k2t_3_two_words_msrvtt_lr_0_0001_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-k2t_3_two_words_msrvtt_lr_0_0001_pipeline_en.md new file mode 100644 index 00000000000000..144a46d15503c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-k2t_3_two_words_msrvtt_lr_0_0001_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_3_two_words_msrvtt_lr_0_0001_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_3_two_words_msrvtt_lr_0_0001_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_3_two_words_msrvtt_lr_0_0001_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_3_two_words_msrvtt_lr_0_0001_pipeline_en_5.4.2_3.0_1724279445093.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_3_two_words_msrvtt_lr_0_0001_pipeline_en_5.4.2_3.0_1724279445093.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_3_two_words_msrvtt_lr_0_0001_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_3_two_words_msrvtt_lr_0_0001_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_3_two_words_msrvtt_lr_0_0001_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.3 MB| + +## References + +https://huggingface.co/taewhan/k2t-3_two_words_msrvtt_lr_0.0001 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-k2t_7_en.md b/docs/_posts/ahmedlone127/2024-08-21-k2t_7_en.md new file mode 100644 index 00000000000000..0de34023a8f595 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-k2t_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_7 T5Transformer from taewhan +author: John Snow Labs +name: k2t_7 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_7` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_7_en_5.4.2_3.0_1724248998941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_7_en_5.4.2_3.0_1724248998941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.3 MB| + +## References + +https://huggingface.co/taewhan/k2t-7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-k2t_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-k2t_7_pipeline_en.md new file mode 100644 index 00000000000000..bf0727a91c45d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-k2t_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_7_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_7_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_7_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_7_pipeline_en_5.4.2_3.0_1724249017752.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_7_pipeline_en_5.4.2_3.0_1724249017752.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.3 MB| + +## References + +https://huggingface.co/taewhan/k2t-7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-khajiit_speak_en.md b/docs/_posts/ahmedlone127/2024-08-21-khajiit_speak_en.md new file mode 100644 index 00000000000000..cd2392fb905682 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-khajiit_speak_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English khajiit_speak T5Transformer from trawzified +author: John Snow Labs +name: khajiit_speak +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`khajiit_speak` is a English model originally trained by trawzified. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/khajiit_speak_en_5.4.2_3.0_1724237468430.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/khajiit_speak_en_5.4.2_3.0_1724237468430.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("khajiit_speak","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("khajiit_speak", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|khajiit_speak| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/trawzified/khajiit-speak \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-khajiit_speak_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-khajiit_speak_pipeline_en.md new file mode 100644 index 00000000000000..de96fcce1032d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-khajiit_speak_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English khajiit_speak_pipeline pipeline T5Transformer from trawzified +author: John Snow Labs +name: khajiit_speak_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`khajiit_speak_pipeline` is a English model originally trained by trawzified. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/khajiit_speak_pipeline_en_5.4.2_3.0_1724237518044.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/khajiit_speak_pipeline_en_5.4.2_3.0_1724237518044.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("khajiit_speak_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("khajiit_speak_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|khajiit_speak_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/trawzified/khajiit-speak + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_en.md new file mode 100644 index 00000000000000..4fce9469257be7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_aposl T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_aposl +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_aposl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aposl_en_5.4.2_3.0_1724278233949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aposl_en_5.4.2_3.0_1724278233949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_aposl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_aposl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_aposl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_APOSL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_pipeline_en.md new file mode 100644 index 00000000000000..287b96132fabf7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_aposl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_aposl_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_aposl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aposl_pipeline_en_5.4.2_3.0_1724278417581.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aposl_pipeline_en_5.4.2_3.0_1724278417581.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_aposl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_aposl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_aposl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_APOSL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_v3_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_v3_en.md new file mode 100644 index 00000000000000..65f9a5f7772590 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_aposl_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_aposl_v3 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_aposl_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aposl_v3_en_5.4.2_3.0_1724280230252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aposl_v3_en_5.4.2_3.0_1724280230252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_aposl_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_aposl_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_aposl_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_APOSL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_v3_pipeline_en.md new file mode 100644 index 00000000000000..4ad1ba52178170 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_aposl_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_aposl_v3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_aposl_v3_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_aposl_v3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aposl_v3_pipeline_en_5.4.2_3.0_1724280402134.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_aposl_v3_pipeline_en_5.4.2_3.0_1724280402134.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_aposl_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_aposl_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_aposl_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_APOSL_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_psoal_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_psoal_en.md new file mode 100644 index 00000000000000..687ca0c286ee4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_psoal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_psoal T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_psoal +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_psoal` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_en_5.4.2_3.0_1724235344064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psoal_en_5.4.2_3.0_1724235344064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_psoal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_psoal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_psoal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PSOAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_soapl_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_soapl_en.md new file mode 100644 index 00000000000000..97ee19831fa9de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_soapl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_soapl T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_soapl +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_soapl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_soapl_en_5.4.2_3.0_1724211395634.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_soapl_en_5.4.2_3.0_1724211395634.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_soapl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_soapl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_soapl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SOAPL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_soapl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_soapl_pipeline_en.md new file mode 100644 index 00000000000000..3bee197299dbfc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_soapl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_soapl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_soapl_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_soapl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_soapl_pipeline_en_5.4.2_3.0_1724211578261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_soapl_pipeline_en_5.4.2_3.0_1724211578261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_soapl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_soapl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_soapl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SOAPL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_total_spaol_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_total_spaol_en.md new file mode 100644 index 00000000000000..0d5e1ccf0cb9f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_total_spaol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_spaol T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_spaol +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_spaol` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_spaol_en_5.4.2_3.0_1724255457727.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_spaol_en_5.4.2_3.0_1724255457727.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_spaol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_spaol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_spaol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SPAOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_total_spaol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_total_spaol_pipeline_en.md new file mode 100644 index 00000000000000..3a82cde87e5ae3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kltn_coqe_vit5_total_spaol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_spaol_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_spaol_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_spaol_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_spaol_pipeline_en_5.4.2_3.0_1724255632182.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_spaol_pipeline_en_5.4.2_3.0_1724255632182.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_spaol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_spaol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_spaol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SPAOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kot5_en.md b/docs/_posts/ahmedlone127/2024-08-21-kot5_en.md new file mode 100644 index 00000000000000..68f9007f95fdfe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kot5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kot5 T5Transformer from psyche +author: John Snow Labs +name: kot5 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kot5` is a English model originally trained by psyche. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kot5_en_5.4.2_3.0_1724214397231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kot5_en_5.4.2_3.0_1724214397231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kot5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kot5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kot5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|521.0 MB| + +## References + +https://huggingface.co/psyche/KoT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-kot5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-kot5_pipeline_en.md new file mode 100644 index 00000000000000..1489f7ed400ca1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-kot5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kot5_pipeline pipeline T5Transformer from psyche +author: John Snow Labs +name: kot5_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kot5_pipeline` is a English model originally trained by psyche. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kot5_pipeline_en_5.4.2_3.0_1724214578338.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kot5_pipeline_en_5.4.2_3.0_1724214578338.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kot5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kot5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kot5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|521.0 MB| + +## References + +https://huggingface.co/psyche/KoT5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_base_chunked_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_base_chunked_en.md new file mode 100644 index 00000000000000..109d16b816fc1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_base_chunked_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_base_chunked T5Transformer from Ashreen +author: John Snow Labs +name: legal_t5_base_chunked +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_base_chunked` is a English model originally trained by Ashreen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_base_chunked_en_5.4.2_3.0_1724210006601.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_base_chunked_en_5.4.2_3.0_1724210006601.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_base_chunked","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_base_chunked", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_base_chunked| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ashreen/legal-t5-base-chunked \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_base_chunked_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_base_chunked_pipeline_en.md new file mode 100644 index 00000000000000..c687af477267f3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_base_chunked_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_base_chunked_pipeline pipeline T5Transformer from Ashreen +author: John Snow Labs +name: legal_t5_base_chunked_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_base_chunked_pipeline` is a English model originally trained by Ashreen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_base_chunked_pipeline_en_5.4.2_3.0_1724210058596.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_base_chunked_pipeline_en_5.4.2_3.0_1724210058596.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_base_chunked_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_base_chunked_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_base_chunked_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ashreen/legal-t5-base-chunked + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_cls_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_cls_spanish_en.md new file mode 100644 index 00000000000000..cda9e932942dcf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_cls_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_cls_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_spanish +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_spanish_en_5.4.2_3.0_1724198951507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_spanish_en_5.4.2_3.0_1724198951507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_cls_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_cls_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|178.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_cls_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_cls_spanish_pipeline_en.md new file mode 100644 index 00000000000000..2f5250eb174c86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_cls_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_cls_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_spanish_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_spanish_pipeline_en_5.4.2_3.0_1724199010106.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_spanish_pipeline_en_5.4.2_3.0_1724199010106.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_cls_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_cls_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|178.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_czech_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_czech_spanish_en.md new file mode 100644 index 00000000000000..64396472b690c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_czech_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_czech_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_czech_spanish +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_czech_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_czech_spanish_en_5.4.2_3.0_1724266070173.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_czech_spanish_en_5.4.2_3.0_1724266070173.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_czech_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_czech_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_czech_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_cs_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_czech_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_czech_spanish_pipeline_en.md new file mode 100644 index 00000000000000..d017cde024d39b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_czech_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_czech_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_czech_spanish_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_czech_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_czech_spanish_pipeline_en_5.4.2_3.0_1724266132652.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_czech_spanish_pipeline_en_5.4.2_3.0_1724266132652.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_czech_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_czech_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_czech_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_cs_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_spanish_czech_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_spanish_czech_en.md new file mode 100644 index 00000000000000..a9942b8992dbb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_spanish_czech_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_spanish_czech T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_spanish_czech +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_spanish_czech` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_spanish_czech_en_5.4.2_3.0_1724259810490.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_spanish_czech_en_5.4.2_3.0_1724259810490.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_spanish_czech","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_spanish_czech", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_spanish_czech| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_es_cs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_spanish_czech_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_spanish_czech_pipeline_en.md new file mode 100644 index 00000000000000..27bcefbe3fb3e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_spanish_czech_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_spanish_czech_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_spanish_czech_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_spanish_czech_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_spanish_czech_pipeline_en_5.4.2_3.0_1724259873651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_spanish_czech_pipeline_en_5.4.2_3.0_1724259873651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_spanish_czech_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_spanish_czech_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_spanish_czech_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_es_cs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_french_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_french_en.md new file mode 100644 index 00000000000000..7bb0bf51662601 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_swedish_french T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_swedish_french +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_swedish_french` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_french_en_5.4.2_3.0_1724225065217.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_french_en_5.4.2_3.0_1724225065217.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_swedish_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_swedish_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_swedish_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_sv_fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_french_pipeline_en.md new file mode 100644 index 00000000000000..18219f757894eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_swedish_french_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_swedish_french_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_swedish_french_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_french_pipeline_en_5.4.2_3.0_1724225128395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_french_pipeline_en_5.4.2_3.0_1724225128395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_swedish_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_swedish_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_swedish_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_sv_fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_german_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_german_en.md new file mode 100644 index 00000000000000..b8de0024334654 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_swedish_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_swedish_german +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_swedish_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_german_en_5.4.2_3.0_1724276200485.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_german_en_5.4.2_3.0_1724276200485.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_swedish_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_swedish_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_swedish_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_sv_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_german_pipeline_en.md new file mode 100644 index 00000000000000..2407d1c5d7b0fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_multitask_swedish_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_swedish_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_swedish_german_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_swedish_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_german_pipeline_en_5.4.2_3.0_1724276260725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_swedish_german_pipeline_en_5.4.2_3.0_1724276260725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_swedish_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_swedish_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_swedish_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_sv_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_summ_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_summ_spanish_en.md new file mode 100644 index 00000000000000..5c2f9177c2611e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_summ_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_summ_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_spanish +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_spanish_en_5.4.2_3.0_1724219975801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_spanish_en_5.4.2_3.0_1724219975801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_summ_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_summ_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|175.8 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_summ_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_summ_spanish_pipeline_en.md new file mode 100644 index 00000000000000..a25d4c8af9e6ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_summ_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_summ_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_spanish_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_spanish_pipeline_en_5.4.2_3.0_1724220033884.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_spanish_pipeline_en_5.4.2_3.0_1724220033884.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_summ_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_summ_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|175.8 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_czech_italian_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_czech_italian_small_finetuned_en.md new file mode 100644 index 00000000000000..9127518fc5a03b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_czech_italian_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_italian_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_italian_small_finetuned +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_italian_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_italian_small_finetuned_en_5.4.2_3.0_1724269203107.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_italian_small_finetuned_en_5.4.2_3.0_1724269203107.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_italian_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_italian_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_italian_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_it_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_czech_italian_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_czech_italian_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..102b62e0d3eb17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_czech_italian_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_italian_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_italian_small_finetuned_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_italian_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_italian_small_finetuned_pipeline_en_5.4.2_3.0_1724269262877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_italian_small_finetuned_pipeline_en_5.4.2_3.0_1724269262877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_czech_italian_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_czech_italian_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_italian_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_it_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_english_czech_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_english_czech_en.md new file mode 100644 index 00000000000000..9684f7dc6a3bd6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_english_czech_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_english_czech T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_english_czech +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_english_czech` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_czech_en_5.4.2_3.0_1724277054877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_czech_en_5.4.2_3.0_1724277054877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_english_czech","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_english_czech", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_english_czech| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.9 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_en_cs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_english_czech_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_english_czech_pipeline_en.md new file mode 100644 index 00000000000000..b9aa4efd981b5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_english_czech_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_english_czech_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_english_czech_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_english_czech_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_czech_pipeline_en_5.4.2_3.0_1724277113838.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_czech_pipeline_en_5.4.2_3.0_1724277113838.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_english_czech_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_english_czech_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_english_czech_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.9 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_en_cs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_french_german_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_french_german_en.md new file mode 100644 index 00000000000000..61ead87259c9d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_french_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_french_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_german +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_german_en_5.4.2_3.0_1724279847256.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_german_en_5.4.2_3.0_1724279847256.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_french_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_french_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_french_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_french_german_pipeline_en.md new file mode 100644 index 00000000000000..7b0b65dfa7e267 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_french_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_french_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_french_german_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_french_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_german_pipeline_en_5.4.2_3.0_1724279904651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_french_german_pipeline_en_5.4.2_3.0_1724279904651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_french_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_french_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_french_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_fr_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_english_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_english_small_finetuned_en.md new file mode 100644 index 00000000000000..3a923e0170854c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_english_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_german_english_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_english_small_finetuned +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_english_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_english_small_finetuned_en_5.4.2_3.0_1724269307554.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_english_small_finetuned_en_5.4.2_3.0_1724269307554.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_german_english_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_german_english_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_english_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_en_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_english_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_english_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..60a5c0ab7aa982 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_english_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_german_english_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_english_small_finetuned_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_english_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_english_small_finetuned_pipeline_en_5.4.2_3.0_1724269365436.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_english_small_finetuned_pipeline_en_5.4.2_3.0_1724269365436.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_german_english_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_german_english_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_english_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_en_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_italian_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_italian_en.md new file mode 100644 index 00000000000000..668818cd4b9f47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_german_italian T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_italian +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_italian` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_italian_en_5.4.2_3.0_1724258491964.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_italian_en_5.4.2_3.0_1724258491964.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_german_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_german_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_italian_pipeline_en.md new file mode 100644 index 00000000000000..c5d79083628f6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_german_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_german_italian_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_german_italian_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_german_italian_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_italian_pipeline_en_5.4.2_3.0_1724258553231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_german_italian_pipeline_en_5.4.2_3.0_1724258553231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_german_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_german_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_german_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_de_it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_italian_english_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_italian_english_en.md new file mode 100644 index 00000000000000..d54930fa4fc3e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_italian_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_italian_english T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_italian_english +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_italian_english` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_english_en_5.4.2_3.0_1724267065183.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_english_en_5.4.2_3.0_1724267065183.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_italian_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_italian_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_italian_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_it_en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_italian_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_italian_english_pipeline_en.md new file mode 100644 index 00000000000000..45c5e66c575b33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-legal_t5_small_trans_italian_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_italian_english_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_italian_english_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_italian_english_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_english_pipeline_en_5.4.2_3.0_1724267125783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_italian_english_pipeline_en_5.4.2_3.0_1724267125783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_italian_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_italian_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_italian_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_it_en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-lit5_distill_base_v2_en.md b/docs/_posts/ahmedlone127/2024-08-21-lit5_distill_base_v2_en.md new file mode 100644 index 00000000000000..9dd85c6c6ffa2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-lit5_distill_base_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lit5_distill_base_v2 T5Transformer from castorini +author: John Snow Labs +name: lit5_distill_base_v2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lit5_distill_base_v2` is a English model originally trained by castorini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lit5_distill_base_v2_en_5.4.2_3.0_1724214438486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lit5_distill_base_v2_en_5.4.2_3.0_1724214438486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lit5_distill_base_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lit5_distill_base_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lit5_distill_base_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/castorini/LiT5-Distill-base-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-lit5_distill_base_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-lit5_distill_base_v2_pipeline_en.md new file mode 100644 index 00000000000000..9c38d92731b10f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-lit5_distill_base_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lit5_distill_base_v2_pipeline pipeline T5Transformer from castorini +author: John Snow Labs +name: lit5_distill_base_v2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lit5_distill_base_v2_pipeline` is a English model originally trained by castorini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lit5_distill_base_v2_pipeline_en_5.4.2_3.0_1724214487770.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lit5_distill_base_v2_pipeline_en_5.4.2_3.0_1724214487770.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lit5_distill_base_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lit5_distill_base_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lit5_distill_base_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/castorini/LiT5-Distill-base-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-long_t5_encodec_tglobal_base_squadv2_en.md b/docs/_posts/ahmedlone127/2024-08-21-long_t5_encodec_tglobal_base_squadv2_en.md new file mode 100644 index 00000000000000..9c0febcf005c5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-long_t5_encodec_tglobal_base_squadv2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_t5_encodec_tglobal_base_squadv2 T5Transformer from MaggiePai +author: John Snow Labs +name: long_t5_encodec_tglobal_base_squadv2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_encodec_tglobal_base_squadv2` is a English model originally trained by MaggiePai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_encodec_tglobal_base_squadv2_en_5.4.2_3.0_1724237931343.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_encodec_tglobal_base_squadv2_en_5.4.2_3.0_1724237931343.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_t5_encodec_tglobal_base_squadv2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_t5_encodec_tglobal_base_squadv2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_encodec_tglobal_base_squadv2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/MaggiePai/long-t5-encodec-tglobal-base_squadv2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-long_t5_encodec_tglobal_base_squadv2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-long_t5_encodec_tglobal_base_squadv2_pipeline_en.md new file mode 100644 index 00000000000000..7d746363de7b90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-long_t5_encodec_tglobal_base_squadv2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_t5_encodec_tglobal_base_squadv2_pipeline pipeline T5Transformer from MaggiePai +author: John Snow Labs +name: long_t5_encodec_tglobal_base_squadv2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_encodec_tglobal_base_squadv2_pipeline` is a English model originally trained by MaggiePai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_encodec_tglobal_base_squadv2_pipeline_en_5.4.2_3.0_1724237984238.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_encodec_tglobal_base_squadv2_pipeline_en_5.4.2_3.0_1724237984238.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_t5_encodec_tglobal_base_squadv2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_t5_encodec_tglobal_base_squadv2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_encodec_tglobal_base_squadv2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/MaggiePai/long-t5-encodec-tglobal-base_squadv2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-med_flan_t5_large_es.md b/docs/_posts/ahmedlone127/2024-08-21-med_flan_t5_large_es.md new file mode 100644 index 00000000000000..0aa28978a7fc5a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-med_flan_t5_large_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish med_flan_t5_large T5Transformer from snorkelai +author: John Snow Labs +name: med_flan_t5_large +date: 2024-08-21 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`med_flan_t5_large` is a Castilian, Spanish model originally trained by snorkelai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/med_flan_t5_large_es_5.4.2_3.0_1724274344913.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/med_flan_t5_large_es_5.4.2_3.0_1724274344913.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("med_flan_t5_large","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("med_flan_t5_large", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|med_flan_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|3.1 GB| + +## References + +https://huggingface.co/snorkelai/med-flan-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-med_flan_t5_large_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-21-med_flan_t5_large_pipeline_es.md new file mode 100644 index 00000000000000..7a5017b0b562de --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-med_flan_t5_large_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish med_flan_t5_large_pipeline pipeline T5Transformer from snorkelai +author: John Snow Labs +name: med_flan_t5_large_pipeline +date: 2024-08-21 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`med_flan_t5_large_pipeline` is a Castilian, Spanish model originally trained by snorkelai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/med_flan_t5_large_pipeline_es_5.4.2_3.0_1724274478703.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/med_flan_t5_large_pipeline_es_5.4.2_3.0_1724274478703.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("med_flan_t5_large_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("med_flan_t5_large_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|med_flan_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|3.1 GB| + +## References + +https://huggingface.co/snorkelai/med-flan-t5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mjbbillsum_en.md b/docs/_posts/ahmedlone127/2024-08-21-mjbbillsum_en.md new file mode 100644 index 00000000000000..7269c43f38783d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mjbbillsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mjbbillsum T5Transformer from mjbeattie +author: John Snow Labs +name: mjbbillsum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mjbbillsum` is a English model originally trained by mjbeattie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mjbbillsum_en_5.4.2_3.0_1724231292405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mjbbillsum_en_5.4.2_3.0_1724231292405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mjbbillsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mjbbillsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mjbbillsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.3 MB| + +## References + +https://huggingface.co/mjbeattie/mjbbillsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mjbbillsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mjbbillsum_pipeline_en.md new file mode 100644 index 00000000000000..0bc32439186f58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mjbbillsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mjbbillsum_pipeline pipeline T5Transformer from mjbeattie +author: John Snow Labs +name: mjbbillsum_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mjbbillsum_pipeline` is a English model originally trained by mjbeattie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mjbbillsum_pipeline_en_5.4.2_3.0_1724231313429.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mjbbillsum_pipeline_en_5.4.2_3.0_1724231313429.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mjbbillsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mjbbillsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mjbbillsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.3 MB| + +## References + +https://huggingface.co/mjbeattie/mjbbillsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mlt5_multilingual_sentiment_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-21-mlt5_multilingual_sentiment_pipeline_xx.md new file mode 100644 index 00000000000000..fff0dc86b920f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mlt5_multilingual_sentiment_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual mlt5_multilingual_sentiment_pipeline pipeline T5Transformer from mgmahi +author: John Snow Labs +name: mlt5_multilingual_sentiment_pipeline +date: 2024-08-21 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mlt5_multilingual_sentiment_pipeline` is a Multilingual model originally trained by mgmahi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mlt5_multilingual_sentiment_pipeline_xx_5.4.2_3.0_1724218129490.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mlt5_multilingual_sentiment_pipeline_xx_5.4.2_3.0_1724218129490.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mlt5_multilingual_sentiment_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mlt5_multilingual_sentiment_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mlt5_multilingual_sentiment_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|1.3 GB| + +## References + +https://huggingface.co/mgmahi/mlt5-multilingual-sentiment + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mlt5_multilingual_sentiment_xx.md b/docs/_posts/ahmedlone127/2024-08-21-mlt5_multilingual_sentiment_xx.md new file mode 100644 index 00000000000000..0578435ef39bd0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mlt5_multilingual_sentiment_xx.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Multilingual mlt5_multilingual_sentiment T5Transformer from mgmahi +author: John Snow Labs +name: mlt5_multilingual_sentiment +date: 2024-08-21 +tags: [xx, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mlt5_multilingual_sentiment` is a Multilingual model originally trained by mgmahi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mlt5_multilingual_sentiment_xx_5.4.2_3.0_1724218013021.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mlt5_multilingual_sentiment_xx_5.4.2_3.0_1724218013021.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mlt5_multilingual_sentiment","xx") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mlt5_multilingual_sentiment", "xx") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mlt5_multilingual_sentiment| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|1.3 GB| + +## References + +https://huggingface.co/mgmahi/mlt5-multilingual-sentiment \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-model_breachers_en.md b/docs/_posts/ahmedlone127/2024-08-21-model_breachers_en.md new file mode 100644 index 00000000000000..bb654181ea3aad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-model_breachers_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English model_breachers T5Transformer from SanketAI +author: John Snow Labs +name: model_breachers +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`model_breachers` is a English model originally trained by SanketAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/model_breachers_en_5.4.2_3.0_1724252217306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/model_breachers_en_5.4.2_3.0_1724252217306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("model_breachers","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("model_breachers", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|model_breachers| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/SanketAI/model_breachers \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-model_breachers_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-model_breachers_pipeline_en.md new file mode 100644 index 00000000000000..ed2024ac4abd11 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-model_breachers_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English model_breachers_pipeline pipeline T5Transformer from SanketAI +author: John Snow Labs +name: model_breachers_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`model_breachers_pipeline` is a English model originally trained by SanketAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/model_breachers_pipeline_en_5.4.2_3.0_1724252265653.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/model_breachers_pipeline_en_5.4.2_3.0_1724252265653.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("model_breachers_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("model_breachers_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|model_breachers_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/SanketAI/model_breachers + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-model_financial_documents_en.md b/docs/_posts/ahmedlone127/2024-08-21-model_financial_documents_en.md new file mode 100644 index 00000000000000..e18a8bb94573eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-model_financial_documents_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English model_financial_documents T5Transformer from searde +author: John Snow Labs +name: model_financial_documents +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`model_financial_documents` is a English model originally trained by searde. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/model_financial_documents_en_5.4.2_3.0_1724284364560.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/model_financial_documents_en_5.4.2_3.0_1724284364560.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("model_financial_documents","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("model_financial_documents", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|model_financial_documents| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|282.2 MB| + +## References + +https://huggingface.co/searde/model-financial-documents \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-model_financial_documents_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-model_financial_documents_pipeline_en.md new file mode 100644 index 00000000000000..7df6ccf02c0165 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-model_financial_documents_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English model_financial_documents_pipeline pipeline T5Transformer from searde +author: John Snow Labs +name: model_financial_documents_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`model_financial_documents_pipeline` is a English model originally trained by searde. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/model_financial_documents_pipeline_en_5.4.2_3.0_1724284398239.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/model_financial_documents_pipeline_en_5.4.2_3.0_1724284398239.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("model_financial_documents_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("model_financial_documents_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|model_financial_documents_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|282.2 MB| + +## References + +https://huggingface.co/searde/model-financial-documents + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mrpc_t5_large_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-21-mrpc_t5_large_seed_3_en.md new file mode 100644 index 00000000000000..913df9f07f1089 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mrpc_t5_large_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mrpc_t5_large_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: mrpc_t5_large_seed_3 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_t5_large_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_t5_large_seed_3_en_5.4.2_3.0_1724208278126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_t5_large_seed_3_en_5.4.2_3.0_1724208278126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mrpc_t5_large_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mrpc_t5_large_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_t5_large_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/mrpc_t5-large_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mrpc_t5_large_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mrpc_t5_large_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..4085d5fb15ceb6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mrpc_t5_large_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mrpc_t5_large_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: mrpc_t5_large_seed_3_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mrpc_t5_large_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mrpc_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724208471845.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mrpc_t5_large_seed_3_pipeline_en_5.4.2_3.0_1724208471845.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mrpc_t5_large_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mrpc_t5_large_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mrpc_t5_large_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/mrpc_t5-large_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-msmarco_dutch_mt5_base_v1_nl.md b/docs/_posts/ahmedlone127/2024-08-21-msmarco_dutch_mt5_base_v1_nl.md new file mode 100644 index 00000000000000..47d5bbefbf7308 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-msmarco_dutch_mt5_base_v1_nl.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Dutch, Flemish msmarco_dutch_mt5_base_v1 T5Transformer from doc2query +author: John Snow Labs +name: msmarco_dutch_mt5_base_v1 +date: 2024-08-21 +tags: [nl, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nl +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`msmarco_dutch_mt5_base_v1` is a Dutch, Flemish model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/msmarco_dutch_mt5_base_v1_nl_5.4.2_3.0_1724251811175.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/msmarco_dutch_mt5_base_v1_nl_5.4.2_3.0_1724251811175.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("msmarco_dutch_mt5_base_v1","nl") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("msmarco_dutch_mt5_base_v1", "nl") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|msmarco_dutch_mt5_base_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|nl| +|Size:|2.5 GB| + +## References + +https://huggingface.co/doc2query/msmarco-dutch-mt5-base-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-msmarco_portuguese_mt5_base_v1_pt.md b/docs/_posts/ahmedlone127/2024-08-21-msmarco_portuguese_mt5_base_v1_pt.md new file mode 100644 index 00000000000000..8b342e4af7ffa4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-msmarco_portuguese_mt5_base_v1_pt.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Portuguese msmarco_portuguese_mt5_base_v1 T5Transformer from doc2query +author: John Snow Labs +name: msmarco_portuguese_mt5_base_v1 +date: 2024-08-21 +tags: [pt, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: pt +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`msmarco_portuguese_mt5_base_v1` is a Portuguese model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/msmarco_portuguese_mt5_base_v1_pt_5.4.2_3.0_1724254857689.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/msmarco_portuguese_mt5_base_v1_pt_5.4.2_3.0_1724254857689.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("msmarco_portuguese_mt5_base_v1","pt") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("msmarco_portuguese_mt5_base_v1", "pt") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|msmarco_portuguese_mt5_base_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|pt| +|Size:|2.5 GB| + +## References + +https://huggingface.co/doc2query/msmarco-portuguese-mt5-base-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_2_normail_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_2_normail_en.md new file mode 100644 index 00000000000000..44165f02b92cc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_2_normail_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_2_normail T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: mt5_base_2_normail +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_2_normail` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_2_normail_en_5.4.2_3.0_1724205791009.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_2_normail_en_5.4.2_3.0_1724205791009.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_2_normail","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_2_normail", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_2_normail| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/mt5_base_2-normail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_2_normail_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_2_normail_pipeline_en.md new file mode 100644 index 00000000000000..e1f3ba1ad2d90b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_2_normail_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_2_normail_pipeline pipeline T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: mt5_base_2_normail_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_2_normail_pipeline` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_2_normail_pipeline_en_5.4.2_3.0_1724205958819.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_2_normail_pipeline_en_5.4.2_3.0_1724205958819.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_2_normail_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_2_normail_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_2_normail_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/mt5_base_2-normail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_3task_highlight_tquad2_pipeline_tr.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_3task_highlight_tquad2_pipeline_tr.md new file mode 100644 index 00000000000000..f0ae4256ad81e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_3task_highlight_tquad2_pipeline_tr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Turkish mt5_base_3task_highlight_tquad2_pipeline pipeline T5Transformer from obss +author: John Snow Labs +name: mt5_base_3task_highlight_tquad2_pipeline +date: 2024-08-21 +tags: [tr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: tr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_3task_highlight_tquad2_pipeline` is a Turkish model originally trained by obss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_3task_highlight_tquad2_pipeline_tr_5.4.2_3.0_1724225161179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_3task_highlight_tquad2_pipeline_tr_5.4.2_3.0_1724225161179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_3task_highlight_tquad2_pipeline", lang = "tr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_3task_highlight_tquad2_pipeline", lang = "tr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_3task_highlight_tquad2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|tr| +|Size:|2.3 GB| + +## References + +https://huggingface.co/obss/mt5-base-3task-highlight-tquad2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_3task_highlight_tquad2_tr.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_3task_highlight_tquad2_tr.md new file mode 100644 index 00000000000000..508a566e7b3145 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_3task_highlight_tquad2_tr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Turkish mt5_base_3task_highlight_tquad2 T5Transformer from obss +author: John Snow Labs +name: mt5_base_3task_highlight_tquad2 +date: 2024-08-21 +tags: [tr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: tr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_3task_highlight_tquad2` is a Turkish model originally trained by obss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_3task_highlight_tquad2_tr_5.4.2_3.0_1724224846620.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_3task_highlight_tquad2_tr_5.4.2_3.0_1724224846620.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_3task_highlight_tquad2","tr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_3task_highlight_tquad2", "tr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_3task_highlight_tquad2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|tr| +|Size:|2.3 GB| + +## References + +https://huggingface.co/obss/mt5-base-3task-highlight-tquad2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_all_250000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_all_250000_en.md new file mode 100644 index 00000000000000..21a71e9d339608 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_all_250000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_all_250000 T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_base_all_250000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_all_250000` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_all_250000_en_5.4.2_3.0_1724278938651.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_all_250000_en_5.4.2_3.0_1724278938651.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_all_250000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_all_250000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_all_250000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_base_all_250000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_all_250000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_all_250000_pipeline_en.md new file mode 100644 index 00000000000000..38f456d83fd3e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_all_250000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_all_250000_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_base_all_250000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_all_250000_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_all_250000_pipeline_en_5.4.2_3.0_1724279120905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_all_250000_pipeline_en_5.4.2_3.0_1724279120905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_all_250000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_all_250000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_all_250000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_base_all_250000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_dequad_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_dequad_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..113a241b119453 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_dequad_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_dequad_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_dequad_ae_trimmed_50000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_ae_trimmed_50000_en_5.4.2_3.0_1724275135302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_ae_trimmed_50000_en_5.4.2_3.0_1724275135302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_dequad_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_dequad_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-dequad-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_dequad_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_dequad_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..16722b388e98a5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_dequad_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_dequad_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_dequad_ae_trimmed_50000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724275189485.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724275189485.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_dequad_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_dequad_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-dequad-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base_en.md new file mode 100644 index 00000000000000..ed6645c246b5ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base T5Transformer from nestoralvaro +author: John Snow Labs +name: mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base` is a English model originally trained by nestoralvaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base_en_5.4.2_3.0_1724245996163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base_en_5.4.2_3.0_1724245996163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_xsum_data_prep_2021_12_26___t2981_22026_csv___topic_text_google_mt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/nestoralvaro/mt5-base-finetuned-xsum-data_prep_2021_12_26___t2981_22026.csv___topic_text_google_mt5_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_frquad_qg_trimmed_75000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_frquad_qg_trimmed_75000_en.md new file mode 100644 index 00000000000000..faad75ab7656e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_frquad_qg_trimmed_75000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_frquad_qg_trimmed_75000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_frquad_qg_trimmed_75000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qg_trimmed_75000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_75000_en_5.4.2_3.0_1724239014262.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_75000_en_5.4.2_3.0_1724239014262.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_frquad_qg_trimmed_75000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_frquad_qg_trimmed_75000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qg_trimmed_75000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-frquad-qg-trimmed-75000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_frquad_qg_trimmed_75000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_frquad_qg_trimmed_75000_pipeline_en.md new file mode 100644 index 00000000000000..e2513d753f54c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_frquad_qg_trimmed_75000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_frquad_qg_trimmed_75000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_frquad_qg_trimmed_75000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qg_trimmed_75000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_75000_pipeline_en_5.4.2_3.0_1724239094958.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_75000_pipeline_en_5.4.2_3.0_1724239094958.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_frquad_qg_trimmed_75000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_frquad_qg_trimmed_75000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qg_trimmed_75000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-frquad-qg-trimmed-75000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_germeval21_toxic_with_task_specific_pretraining_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_germeval21_toxic_with_task_specific_pretraining_en.md new file mode 100644 index 00000000000000..d5cad72002b146 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_germeval21_toxic_with_task_specific_pretraining_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_germeval21_toxic_with_task_specific_pretraining T5Transformer from airKlizz +author: John Snow Labs +name: mt5_base_germeval21_toxic_with_task_specific_pretraining +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_germeval21_toxic_with_task_specific_pretraining` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_with_task_specific_pretraining_en_5.4.2_3.0_1724203082750.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_with_task_specific_pretraining_en_5.4.2_3.0_1724203082750.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_germeval21_toxic_with_task_specific_pretraining","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_germeval21_toxic_with_task_specific_pretraining", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_germeval21_toxic_with_task_specific_pretraining| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/airKlizz/mt5-base-germeval21-toxic-with-task-specific-pretraining \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline_en.md new file mode 100644 index 00000000000000..0b434ac8f5ddab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline pipeline T5Transformer from airKlizz +author: John Snow Labs +name: mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline_en_5.4.2_3.0_1724203245082.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline_en_5.4.2_3.0_1724203245082.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_germeval21_toxic_with_task_specific_pretraining_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/airKlizz/mt5-base-germeval21-toxic-with-task-specific-pretraining + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_headline_generation_it.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_headline_generation_it.md new file mode 100644 index 00000000000000..7532863ed1d151 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_headline_generation_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_base_headline_generation T5Transformer from gsarti +author: John Snow Labs +name: mt5_base_headline_generation +date: 2024-08-21 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_headline_generation` is a Italian model originally trained by gsarti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_headline_generation_it_5.4.2_3.0_1724230722415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_headline_generation_it_5.4.2_3.0_1724230722415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_headline_generation","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_headline_generation", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_headline_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|2.5 GB| + +## References + +https://huggingface.co/gsarti/mt5-base-headline-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_headline_generation_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_headline_generation_pipeline_it.md new file mode 100644 index 00000000000000..adc1e96f5ca408 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_headline_generation_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_base_headline_generation_pipeline pipeline T5Transformer from gsarti +author: John Snow Labs +name: mt5_base_headline_generation_pipeline +date: 2024-08-21 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_headline_generation_pipeline` is a Italian model originally trained by gsarti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_headline_generation_pipeline_it_5.4.2_3.0_1724230964645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_headline_generation_pipeline_it_5.4.2_3.0_1724230964645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_headline_generation_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_headline_generation_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_headline_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|2.5 GB| + +## References + +https://huggingface.co/gsarti/mt5-base-headline-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_ende_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_ende_en.md new file mode 100644 index 00000000000000..d2641d181f5736 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_ende_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_250k_ende T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_250k_ende +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_250k_ende` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_ende_en_5.4.2_3.0_1724267308575.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_ende_en_5.4.2_3.0_1724267308575.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_250k_ende","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_250k_ende", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_250k_ende| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-250k-ende \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_ende_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_ende_pipeline_en.md new file mode 100644 index 00000000000000..bf855a26856eb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_ende_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_250k_ende_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_250k_ende_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_250k_ende_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_ende_pipeline_en_5.4.2_3.0_1724267576788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_ende_pipeline_en_5.4.2_3.0_1724267576788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_250k_ende_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_250k_ende_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_250k_ende_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-250k-ende + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_enru_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_enru_en.md new file mode 100644 index 00000000000000..cab5413ff4a7d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_nc16_250k_enru_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_250k_enru T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_250k_enru +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_250k_enru` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_enru_en_5.4.2_3.0_1724203340158.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_enru_en_5.4.2_3.0_1724203340158.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_250k_enru","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_250k_enru", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_250k_enru| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-250k-enru \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_smesum_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_smesum_en.md new file mode 100644 index 00000000000000..351843eb1c8b96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_smesum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_smesum T5Transformer from ctu-aic +author: John Snow Labs +name: mt5_base_smesum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_smesum` is a English model originally trained by ctu-aic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_smesum_en_5.4.2_3.0_1724206395644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_smesum_en_5.4.2_3.0_1724206395644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_smesum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_smesum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_smesum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/ctu-aic/mt5-base-smesum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_thai_budget_seq_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_thai_budget_seq_en.md new file mode 100644 index 00000000000000..29770ffa82ac05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_thai_budget_seq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_thai_budget_seq T5Transformer from napatswift +author: John Snow Labs +name: mt5_base_thai_budget_seq +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_thai_budget_seq` is a English model originally trained by napatswift. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_thai_budget_seq_en_5.4.2_3.0_1724274987558.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_thai_budget_seq_en_5.4.2_3.0_1724274987558.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_thai_budget_seq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_thai_budget_seq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_thai_budget_seq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|969.1 MB| + +## References + +https://huggingface.co/napatswift/mt5-base-th-budget-seq \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_thai_budget_seq_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_thai_budget_seq_pipeline_en.md new file mode 100644 index 00000000000000..1f76e1a91255ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_thai_budget_seq_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_thai_budget_seq_pipeline pipeline T5Transformer from napatswift +author: John Snow Labs +name: mt5_base_thai_budget_seq_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_thai_budget_seq_pipeline` is a English model originally trained by napatswift. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_thai_budget_seq_pipeline_en_5.4.2_3.0_1724275035710.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_thai_budget_seq_pipeline_en_5.4.2_3.0_1724275035710.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_thai_budget_seq_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_thai_budget_seq_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_thai_budget_seq_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|969.1 MB| + +## References + +https://huggingface.co/napatswift/mt5-base-th-budget-seq + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_15000_dequad_qg_de.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_15000_dequad_qg_de.md new file mode 100644 index 00000000000000..7a71e4ba2a3702 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_15000_dequad_qg_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German mt5_base_trimmed_german_15000_dequad_qg T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_15000_dequad_qg +date: 2024-08-21 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_15000_dequad_qg` is a German model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_15000_dequad_qg_de_5.4.2_3.0_1724232767904.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_15000_dequad_qg_de_5.4.2_3.0_1724232767904.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_german_15000_dequad_qg","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_german_15000_dequad_qg", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_15000_dequad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|867.3 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-15000-dequad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_15000_dequad_qg_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_15000_dequad_qg_pipeline_de.md new file mode 100644 index 00000000000000..9b0608de83e734 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_15000_dequad_qg_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German mt5_base_trimmed_german_15000_dequad_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_15000_dequad_qg_pipeline +date: 2024-08-21 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_15000_dequad_qg_pipeline` is a German model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_15000_dequad_qg_pipeline_de_5.4.2_3.0_1724232810462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_15000_dequad_qg_pipeline_de_5.4.2_3.0_1724232810462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_german_15000_dequad_qg_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_german_15000_dequad_qg_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_15000_dequad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|867.3 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-15000-dequad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_90000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_90000_en.md new file mode 100644 index 00000000000000..bf5292a845930a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_german_90000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_90000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_90000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_90000_en_5.4.2_3.0_1724207745648.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_90000_en_5.4.2_3.0_1724207745648.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_german_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_german_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|777.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_90000_pipeline_en.md new file mode 100644 index 00000000000000..998dcd356f4b52 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_base_trimmed_german_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_german_90000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_90000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_90000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_90000_pipeline_en_5.4.2_3.0_1724208012670.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_90000_pipeline_en_5.4.2_3.0_1724208012670.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_german_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_german_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|777.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq2seq_2_pipeline_th.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq2seq_2_pipeline_th.md new file mode 100644 index 00000000000000..b97c149b4f2e3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq2seq_2_pipeline_th.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Thai mt5_budget_seq2seq_2_pipeline pipeline T5Transformer from napatswift +author: John Snow Labs +name: mt5_budget_seq2seq_2_pipeline +date: 2024-08-21 +tags: [th, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: th +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_budget_seq2seq_2_pipeline` is a Thai model originally trained by napatswift. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_budget_seq2seq_2_pipeline_th_5.4.2_3.0_1724259698483.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_budget_seq2seq_2_pipeline_th_5.4.2_3.0_1724259698483.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_budget_seq2seq_2_pipeline", lang = "th") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_budget_seq2seq_2_pipeline", lang = "th") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_budget_seq2seq_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|th| +|Size:|969.5 MB| + +## References + +https://huggingface.co/napatswift/mt5-budget-seq2seq-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq2seq_2_th.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq2seq_2_th.md new file mode 100644 index 00000000000000..090ecc206a875c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq2seq_2_th.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Thai mt5_budget_seq2seq_2 T5Transformer from napatswift +author: John Snow Labs +name: mt5_budget_seq2seq_2 +date: 2024-08-21 +tags: [th, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: th +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_budget_seq2seq_2` is a Thai model originally trained by napatswift. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_budget_seq2seq_2_th_5.4.2_3.0_1724259651494.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_budget_seq2seq_2_th_5.4.2_3.0_1724259651494.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_budget_seq2seq_2","th") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_budget_seq2seq_2", "th") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_budget_seq2seq_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|th| +|Size:|969.5 MB| + +## References + +https://huggingface.co/napatswift/mt5-budget-seq2seq-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq_en.md new file mode 100644 index 00000000000000..1d6b0fe1ae7020 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_budget_seq T5Transformer from napatswift +author: John Snow Labs +name: mt5_budget_seq +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_budget_seq` is a English model originally trained by napatswift. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_budget_seq_en_5.4.2_3.0_1724277616657.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_budget_seq_en_5.4.2_3.0_1724277616657.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_budget_seq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_budget_seq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_budget_seq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/napatswift/mt5-budget-seq \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq_pipeline_en.md new file mode 100644 index 00000000000000..b7a40a526a02e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_budget_seq_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_budget_seq_pipeline pipeline T5Transformer from napatswift +author: John Snow Labs +name: mt5_budget_seq_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_budget_seq_pipeline` is a English model originally trained by napatswift. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_budget_seq_pipeline_en_5.4.2_3.0_1724277662126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_budget_seq_pipeline_en_5.4.2_3.0_1724277662126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_budget_seq_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_budget_seq_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_budget_seq_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/napatswift/mt5-budget-seq + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_drcd_qa_zh.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_drcd_qa_zh.md new file mode 100644 index 00000000000000..647bbb95aadccb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_drcd_qa_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese mt5_drcd_qa T5Transformer from chiawen0104 +author: John Snow Labs +name: mt5_drcd_qa +date: 2024-08-21 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_drcd_qa` is a Chinese model originally trained by chiawen0104. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_drcd_qa_zh_5.4.2_3.0_1724248447361.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_drcd_qa_zh_5.4.2_3.0_1724248447361.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_drcd_qa","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_drcd_qa", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_drcd_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chiawen0104/mt5-drcd-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_english_yor_news_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_english_yor_news_en.md new file mode 100644 index 00000000000000..5caf86a4f33623 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_english_yor_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_english_yor_news T5Transformer from masakhane +author: John Snow Labs +name: mt5_english_yor_news +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_yor_news` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_yor_news_en_5.4.2_3.0_1724261454218.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_yor_news_en_5.4.2_3.0_1724261454218.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_english_yor_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_english_yor_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_yor_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/masakhane/mt5_en_yor_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_ewe_french_news_fr.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_ewe_french_news_fr.md new file mode 100644 index 00000000000000..29e4afd6657dc3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_ewe_french_news_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_ewe_french_news T5Transformer from masakhane +author: John Snow Labs +name: mt5_ewe_french_news +date: 2024-08-21 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_ewe_french_news` is a French model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_ewe_french_news_fr_5.4.2_3.0_1724221333030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_ewe_french_news_fr_5.4.2_3.0_1724221333030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_ewe_french_news","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_ewe_french_news", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_ewe_french_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_ewe_fr_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_ewe_french_news_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_ewe_french_news_pipeline_fr.md new file mode 100644 index 00000000000000..8f3e151440377c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_ewe_french_news_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_ewe_french_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: mt5_ewe_french_news_pipeline +date: 2024-08-21 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_ewe_french_news_pipeline` is a French model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_ewe_french_news_pipeline_fr_5.4.2_3.0_1724221650631.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_ewe_french_news_pipeline_fr_5.4.2_3.0_1724221650631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_ewe_french_news_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_ewe_french_news_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_ewe_french_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_ewe_fr_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_finetuned_accelerate_norwegian_email_sum_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_finetuned_accelerate_norwegian_email_sum_en.md new file mode 100644 index 00000000000000..8ecf04ba14f16b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_finetuned_accelerate_norwegian_email_sum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_finetuned_accelerate_norwegian_email_sum T5Transformer from tevosianv +author: John Snow Labs +name: mt5_finetuned_accelerate_norwegian_email_sum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_accelerate_norwegian_email_sum` is a English model originally trained by tevosianv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_accelerate_norwegian_email_sum_en_5.4.2_3.0_1724248129934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_accelerate_norwegian_email_sum_en_5.4.2_3.0_1724248129934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_finetuned_accelerate_norwegian_email_sum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_finetuned_accelerate_norwegian_email_sum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_accelerate_norwegian_email_sum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/tevosianv/mt5-finetuned-accelerate-no-email-sum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_finetuned_accelerate_norwegian_email_sum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_finetuned_accelerate_norwegian_email_sum_pipeline_en.md new file mode 100644 index 00000000000000..ca2908b86971a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_finetuned_accelerate_norwegian_email_sum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_finetuned_accelerate_norwegian_email_sum_pipeline pipeline T5Transformer from tevosianv +author: John Snow Labs +name: mt5_finetuned_accelerate_norwegian_email_sum_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_accelerate_norwegian_email_sum_pipeline` is a English model originally trained by tevosianv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_accelerate_norwegian_email_sum_pipeline_en_5.4.2_3.0_1724248288783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_accelerate_norwegian_email_sum_pipeline_en_5.4.2_3.0_1724248288783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_finetuned_accelerate_norwegian_email_sum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_finetuned_accelerate_norwegian_email_sum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_accelerate_norwegian_email_sum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/tevosianv/mt5-finetuned-accelerate-no-email-sum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_german_rr_1000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_german_rr_1000_en.md new file mode 100644 index 00000000000000..bd0ce98c5f7301 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_german_rr_1000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_german_rr_1000 T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_german_rr_1000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_german_rr_1000` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_german_rr_1000_en_5.4.2_3.0_1724264249045.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_german_rr_1000_en_5.4.2_3.0_1724264249045.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_german_rr_1000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_german_rr_1000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_german_rr_1000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-de-rr-1000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_german_rr_1000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_german_rr_1000_pipeline_en.md new file mode 100644 index 00000000000000..4526996c27b619 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_german_rr_1000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_german_rr_1000_pipeline pipeline T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_german_rr_1000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_german_rr_1000_pipeline` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_german_rr_1000_pipeline_en_5.4.2_3.0_1724264427037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_german_rr_1000_pipeline_en_5.4.2_3.0_1724264427037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_german_rr_1000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_german_rr_1000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_german_rr_1000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-de-rr-1000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_mini9l_ja.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_mini9l_ja.md new file mode 100644 index 00000000000000..366c96268eea58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_mini9l_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_mini9l T5Transformer from kkuramitsu +author: John Snow Labs +name: mt5_mini9l +date: 2024-08-21 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_mini9l` is a Japanese model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_mini9l_ja_5.4.2_3.0_1724280664276.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_mini9l_ja_5.4.2_3.0_1724280664276.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_mini9l","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_mini9l", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_mini9l| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|347.1 MB| + +## References + +https://huggingface.co/kkuramitsu/mt5-mini9L \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_mini9l_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_mini9l_pipeline_ja.md new file mode 100644 index 00000000000000..27f4967aeabc59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_mini9l_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_mini9l_pipeline pipeline T5Transformer from kkuramitsu +author: John Snow Labs +name: mt5_mini9l_pipeline +date: 2024-08-21 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_mini9l_pipeline` is a Japanese model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_mini9l_pipeline_ja_5.4.2_3.0_1724280681698.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_mini9l_pipeline_ja_5.4.2_3.0_1724280681698.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_mini9l_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_mini9l_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_mini9l_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|347.1 MB| + +## References + +https://huggingface.co/kkuramitsu/mt5-mini9L + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_py2500_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_py2500_en.md new file mode 100644 index 00000000000000..d01f456711d608 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_py2500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_py2500 T5Transformer from Roy029 +author: John Snow Labs +name: mt5_py2500 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_py2500` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_py2500_en_5.4.2_3.0_1724210541577.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_py2500_en_5.4.2_3.0_1724210541577.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_py2500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_py2500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_py2500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Roy029/mt5_py2500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_py2500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_py2500_pipeline_en.md new file mode 100644 index 00000000000000..1d71d8c6c4ac3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_py2500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_py2500_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: mt5_py2500_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_py2500_pipeline` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_py2500_pipeline_en_5.4.2_3.0_1724210707515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_py2500_pipeline_en_5.4.2_3.0_1724210707515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_py2500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_py2500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_py2500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Roy029/mt5_py2500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_50000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_50000_en.md new file mode 100644 index 00000000000000..077861cb33f1c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_50000 T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_small_50000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_50000` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_50000_en_5.4.2_3.0_1724277784092.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_50000_en_5.4.2_3.0_1724277784092.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_small_50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_50000_pipeline_en.md new file mode 100644 index 00000000000000..bd7c94414ff3cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_50000_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_small_50000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_50000_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_50000_pipeline_en_5.4.2_3.0_1724277899776.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_50000_pipeline_en_5.4.2_3.0_1724277899776.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_small_50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_all_125000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_all_125000_en.md new file mode 100644 index 00000000000000..7a9428ac7f00c0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_all_125000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_all_125000 T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_small_all_125000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_all_125000` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_all_125000_en_5.4.2_3.0_1724245376070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_all_125000_en_5.4.2_3.0_1724245376070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_all_125000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_all_125000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_all_125000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_small_all_125000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_all_125000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_all_125000_pipeline_en.md new file mode 100644 index 00000000000000..dc6d75f3c8eb6b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_all_125000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_all_125000_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_small_all_125000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_all_125000_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_all_125000_pipeline_en_5.4.2_3.0_1724245481057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_all_125000_pipeline_en_5.4.2_3.0_1724245481057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_all_125000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_all_125000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_all_125000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_small_all_125000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_en.md new file mode 100644 index 00000000000000..b061f916e0bdd9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model T5Transformer from AbhiKrov +author: John Snow Labs +name: mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model` is a English model originally trained by AbhiKrov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_en_5.4.2_3.0_1724279598860.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_en_5.4.2_3.0_1724279598860.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/AbhiKrov/mt5-small-english-to-hindi-akrov_chota_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline_en.md new file mode 100644 index 00000000000000..69b41b3cc9e4fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline pipeline T5Transformer from AbhiKrov +author: John Snow Labs +name: mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline` is a English model originally trained by AbhiKrov. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline_en_5.4.2_3.0_1724279718804.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline_en_5.4.2_3.0_1724279718804.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_english_tonga_tonga_islands_hindi_akrov_chota_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/AbhiKrov/mt5-small-english-to-hindi-akrov_chota_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_en.md new file mode 100644 index 00000000000000..f0384d0f5176d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian T5Transformer from mriggs +author: John Snow Labs +name: mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian` is a English model originally trained by mriggs. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_en_5.4.2_3.0_1724211407242.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_en_5.4.2_3.0_1724211407242.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/mriggs/mt5-small-finetuned-1epoch-kde4-en-to-it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline_en.md new file mode 100644 index 00000000000000..3c30f1fc2dd5a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline pipeline T5Transformer from mriggs +author: John Snow Labs +name: mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline` is a English model originally trained by mriggs. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline_en_5.4.2_3.0_1724211507014.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline_en_5.4.2_3.0_1724211507014.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_1epoch_kde4_english_tonga_tonga_islands_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/mriggs/mt5-small-finetuned-1epoch-kde4-en-to-it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_24jan_6_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_24jan_6_en.md new file mode 100644 index 00000000000000..0e4b6c96b22093 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_24jan_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_24jan_6 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_24jan_6 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_24jan_6` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24jan_6_en_5.4.2_3.0_1724206351950.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24jan_6_en_5.4.2_3.0_1724206351950.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_24jan_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_24jan_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_24jan_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-24jan-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_24jan_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_24jan_6_pipeline_en.md new file mode 100644 index 00000000000000..df8ef3ab11d77b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_24jan_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_24jan_6_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_24jan_6_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_24jan_6_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24jan_6_pipeline_en_5.4.2_3.0_1724206446266.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24jan_6_pipeline_en_5.4.2_3.0_1724206446266.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_24jan_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_24jan_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_24jan_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-24jan-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_en.md new file mode 100644 index 00000000000000..1775459a2ad53e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket T5Transformer from Auxiliarytrinket +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket` is a English model originally trained by Auxiliarytrinket. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_en_5.4.2_3.0_1724276869813.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_en_5.4.2_3.0_1724276869813.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Auxiliarytrinket/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline_en.md new file mode 100644 index 00000000000000..d1dd4db181cc0a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline pipeline T5Transformer from Auxiliarytrinket +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline` is a English model originally trained by Auxiliarytrinket. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline_en_5.4.2_3.0_1724276987851.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline_en_5.4.2_3.0_1724276987851.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_auxiliarytrinket_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Auxiliarytrinket/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_dmlea_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_dmlea_en.md new file mode 100644 index 00000000000000..a0f7b49791194b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_dmlea_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_dmlea T5Transformer from dmlea +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_dmlea +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_dmlea` is a English model originally trained by dmlea. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_dmlea_en_5.4.2_3.0_1724206115372.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_dmlea_en_5.4.2_3.0_1724206115372.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_dmlea","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_dmlea", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_dmlea| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/dmlea/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline_en.md new file mode 100644 index 00000000000000..5464c84c5df0e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline pipeline T5Transformer from dmlea +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline` is a English model originally trained by dmlea. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline_en_5.4.2_3.0_1724206242859.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline_en_5.4.2_3.0_1724206242859.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_dmlea_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/dmlea/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_gnomex_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_gnomex_en.md new file mode 100644 index 00000000000000..a048b9f6aad380 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_gnomex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_gnomex T5Transformer from GnomeX +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_gnomex +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_gnomex` is a English model originally trained by GnomeX. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_gnomex_en_5.4.2_3.0_1724258627301.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_gnomex_en_5.4.2_3.0_1724258627301.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_gnomex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_gnomex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_gnomex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|973.6 MB| + +## References + +https://huggingface.co/GnomeX/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline_en.md new file mode 100644 index 00000000000000..4c0ca64e544664 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline pipeline T5Transformer from GnomeX +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline` is a English model originally trained by GnomeX. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline_en_5.4.2_3.0_1724258798366.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline_en_5.4.2_3.0_1724258798366.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_gnomex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|973.6 MB| + +## References + +https://huggingface.co/GnomeX/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_en.md new file mode 100644 index 00000000000000..0c693f8860d812 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper T5Transformer from hippoeatingpaper +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper` is a English model originally trained by hippoeatingpaper. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_en_5.4.2_3.0_1724246638966.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_en_5.4.2_3.0_1724246638966.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/hippoeatingpaper/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline_en.md new file mode 100644 index 00000000000000..38842801a9611e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline pipeline T5Transformer from hippoeatingpaper +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline` is a English model originally trained by hippoeatingpaper. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline_en_5.4.2_3.0_1724246762733.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline_en_5.4.2_3.0_1724246762733.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_hippoeatingpaper_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/hippoeatingpaper/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_ruo23_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_ruo23_en.md new file mode 100644 index 00000000000000..90fca36c9020db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_ruo23_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_ruo23 T5Transformer from ruo23 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_ruo23 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_ruo23` is a English model originally trained by ruo23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_ruo23_en_5.4.2_3.0_1724240969471.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_ruo23_en_5.4.2_3.0_1724240969471.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_ruo23","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_ruo23", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_ruo23| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ruo23/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline_en.md new file mode 100644 index 00000000000000..3babc71103979b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline pipeline T5Transformer from ruo23 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline` is a English model originally trained by ruo23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline_en_5.4.2_3.0_1724241087730.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline_en_5.4.2_3.0_1724241087730.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_ruo23_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ruo23/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_snehas_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_snehas_en.md new file mode 100644 index 00000000000000..5b04dc3fe62bf2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_snehas_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_snehas T5Transformer from SnehaS +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_snehas +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_snehas` is a English model originally trained by SnehaS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_snehas_en_5.4.2_3.0_1724207410167.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_snehas_en_5.4.2_3.0_1724207410167.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_snehas","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_snehas", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_snehas| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/SnehaS/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_snehas_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_snehas_pipeline_en.md new file mode 100644 index 00000000000000..18dba29c130e93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_snehas_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_snehas_pipeline pipeline T5Transformer from SnehaS +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_snehas_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_snehas_pipeline` is a English model originally trained by SnehaS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_snehas_pipeline_en_5.4.2_3.0_1724207537016.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_snehas_pipeline_en_5.4.2_3.0_1724207537016.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_snehas_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_snehas_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_snehas_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/SnehaS/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_thibone14_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_thibone14_en.md new file mode 100644 index 00000000000000..1b6a134231b1d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_thibone14_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_thibone14 T5Transformer from Thibone14 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_thibone14 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_thibone14` is a English model originally trained by Thibone14. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_thibone14_en_5.4.2_3.0_1724205390649.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_thibone14_en_5.4.2_3.0_1724205390649.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_thibone14","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_thibone14", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_thibone14| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Thibone14/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline_en.md new file mode 100644 index 00000000000000..f332b9c75f7130 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline pipeline T5Transformer from Thibone14 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline` is a English model originally trained by Thibone14. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline_en_5.4.2_3.0_1724205487783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline_en_5.4.2_3.0_1724205487783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_thibone14_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Thibone14/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_audio_text_cc_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_audio_text_cc_en.md new file mode 100644 index 00000000000000..99d2e236084569 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_audio_text_cc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_audio_text_cc T5Transformer from marianna13 +author: John Snow Labs +name: mt5_small_finetuned_audio_text_cc +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_audio_text_cc` is a English model originally trained by marianna13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_audio_text_cc_en_5.4.2_3.0_1724262363824.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_audio_text_cc_en_5.4.2_3.0_1724262363824.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_audio_text_cc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_audio_text_cc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_audio_text_cc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/marianna13/mt5-small-finetuned-audio-text-cc \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_audio_text_cc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_audio_text_cc_pipeline_en.md new file mode 100644 index 00000000000000..68dc1e447f79aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_audio_text_cc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_audio_text_cc_pipeline pipeline T5Transformer from marianna13 +author: John Snow Labs +name: mt5_small_finetuned_audio_text_cc_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_audio_text_cc_pipeline` is a English model originally trained by marianna13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_audio_text_cc_pipeline_en_5.4.2_3.0_1724262640434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_audio_text_cc_pipeline_en_5.4.2_3.0_1724262640434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_audio_text_cc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_audio_text_cc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_audio_text_cc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/marianna13/mt5-small-finetuned-audio-text-cc + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_en.md new file mode 100644 index 00000000000000..0b883980cd3c20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_src_tonga_tonga_islands_trg_testing T5Transformer from s3h +author: John Snow Labs +name: mt5_small_finetuned_src_tonga_tonga_islands_trg_testing +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_src_tonga_tonga_islands_trg_testing` is a English model originally trained by s3h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_en_5.4.2_3.0_1724226180433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_en_5.4.2_3.0_1724226180433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_src_tonga_tonga_islands_trg_testing","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_src_tonga_tonga_islands_trg_testing", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_src_tonga_tonga_islands_trg_testing| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|983.5 MB| + +## References + +https://huggingface.co/s3h/mt5-small-finetuned-src-to-trg-testing \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline_en.md new file mode 100644 index 00000000000000..637d6d9bc0b281 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline pipeline T5Transformer from s3h +author: John Snow Labs +name: mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline` is a English model originally trained by s3h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline_en_5.4.2_3.0_1724226346210.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline_en_5.4.2_3.0_1724226346210.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_src_tonga_tonga_islands_trg_testing_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|983.5 MB| + +## References + +https://huggingface.co/s3h/mt5-small-finetuned-src-to-trg-testing + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_ae_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_ae_pipeline_fr.md new file mode 100644 index 00000000000000..6dbc9f83643dc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_ae_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_frquad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_frquad_ae_pipeline +date: 2024-08-21 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_ae_pipeline` is a French model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_ae_pipeline_fr_5.4.2_3.0_1724205106541.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_ae_pipeline_fr_5.4.2_3.0_1724205106541.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_ae_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_ae_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-frquad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qa_trimmed_french_120000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qa_trimmed_french_120000_en.md new file mode 100644 index 00000000000000..4105370bb85f5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qa_trimmed_french_120000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qa_trimmed_french_120000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qa_trimmed_french_120000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qa_trimmed_french_120000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_120000_en_5.4.2_3.0_1724244714291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_120000_en_5.4.2_3.0_1724244714291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qa_trimmed_french_120000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qa_trimmed_french_120000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qa_trimmed_french_120000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|702.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qa-trimmed-fr-120000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qa_trimmed_french_120000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qa_trimmed_french_120000_pipeline_en.md new file mode 100644 index 00000000000000..877eb5a573da5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qa_trimmed_french_120000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qa_trimmed_french_120000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qa_trimmed_french_120000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qa_trimmed_french_120000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_120000_pipeline_en_5.4.2_3.0_1724244760576.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qa_trimmed_french_120000_pipeline_en_5.4.2_3.0_1724244760576.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qa_trimmed_french_120000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qa_trimmed_french_120000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qa_trimmed_french_120000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|702.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qa-trimmed-fr-120000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_30000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_30000_en.md new file mode 100644 index 00000000000000..60b097cbf2e881 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_30000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_30000_en_5.4.2_3.0_1724284506507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_30000_en_5.4.2_3.0_1724284506507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_30000_pipeline_en.md new file mode 100644 index 00000000000000..536fa4665671fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_30000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_30000_pipeline_en_5.4.2_3.0_1724284525824.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_30000_pipeline_en_5.4.2_3.0_1724284525824.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_90000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_90000_en.md new file mode 100644 index 00000000000000..1db4153e570c10 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_90000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_90000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_90000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_90000_en_5.4.2_3.0_1724273421134.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_90000_en_5.4.2_3.0_1724273421134.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|581.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_90000_pipeline_en.md new file mode 100644 index 00000000000000..720e6bddeaa8bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_frquad_qg_trimmed_french_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_90000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_90000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_90000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_90000_pipeline_en_5.4.2_3.0_1724273455933.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_90000_pipeline_en_5.4.2_3.0_1724273455933.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|581.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..163808101c6c5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_itquad_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_ae_trimmed_50000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_ae_trimmed_50000_en_5.4.2_3.0_1724232971491.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_ae_trimmed_50000_en_5.4.2_3.0_1724232971491.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_itquad_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_itquad_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|434.5 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..1cb33e6d3e3686 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_itquad_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_ae_trimmed_50000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724232993955.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724232993955.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|434.5 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_ae_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_ae_pipeline_it.md new file mode 100644 index 00000000000000..0b9dd6019f006b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_ae_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_small_itquad_qg_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qg_ae_pipeline +date: 2024-08-21 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg_ae_pipeline` is a Italian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_ae_pipeline_it_5.4.2_3.0_1724276743835.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_ae_pipeline_it_5.4.2_3.0_1724276743835.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_qg_ae_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_qg_ae_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|1.2 GB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qg-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_trimmed_50000_en.md new file mode 100644 index 00000000000000..ef10e0834d7b48 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_itquad_qg_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qg_trimmed_50000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_trimmed_50000_en_5.4.2_3.0_1724241533513.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_trimmed_50000_en_5.4.2_3.0_1724241533513.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_itquad_qg_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_itquad_qg_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|435.0 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qg-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..fa2419b104ea4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_itquad_qg_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_itquad_qg_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_itquad_qg_trimmed_50000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_itquad_qg_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_trimmed_50000_pipeline_en_5.4.2_3.0_1724241555999.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_itquad_qg_trimmed_50000_pipeline_en_5.4.2_3.0_1724241555999.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_itquad_qg_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_itquad_qg_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_itquad_qg_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|435.0 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-itquad-qg-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_jaquad_qg_trimmed_japanese_60000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_jaquad_qg_trimmed_japanese_60000_en.md new file mode 100644 index 00000000000000..a85a09b36cca83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_jaquad_qg_trimmed_japanese_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_jaquad_qg_trimmed_japanese_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qg_trimmed_japanese_60000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qg_trimmed_japanese_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_60000_en_5.4.2_3.0_1724280651012.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_60000_en_5.4.2_3.0_1724280651012.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_jaquad_qg_trimmed_japanese_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_jaquad_qg_trimmed_japanese_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qg_trimmed_japanese_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|457.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qg-trimmed-ja-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline_en.md new file mode 100644 index 00000000000000..51dfd9eb6b2bcb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline_en_5.4.2_3.0_1724280676170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline_en_5.4.2_3.0_1724280676170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qg_trimmed_japanese_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|457.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qg-trimmed-ja-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_mlsum_domain_specific_paraphraser_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_mlsum_domain_specific_paraphraser_v1_en.md new file mode 100644 index 00000000000000..79ec617ae8de59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_mlsum_domain_specific_paraphraser_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_mlsum_domain_specific_paraphraser_v1 T5Transformer from guidoivetta +author: John Snow Labs +name: mt5_small_mlsum_domain_specific_paraphraser_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mlsum_domain_specific_paraphraser_v1` is a English model originally trained by guidoivetta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mlsum_domain_specific_paraphraser_v1_en_5.4.2_3.0_1724241334833.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mlsum_domain_specific_paraphraser_v1_en_5.4.2_3.0_1724241334833.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_mlsum_domain_specific_paraphraser_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_mlsum_domain_specific_paraphraser_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mlsum_domain_specific_paraphraser_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/guidoivetta/mt5-small-mlsum_domain-specific-paraphraser_V1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline_en.md new file mode 100644 index 00000000000000..eb80bedf972646 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline pipeline T5Transformer from guidoivetta +author: John Snow Labs +name: mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline` is a English model originally trained by guidoivetta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline_en_5.4.2_3.0_1724241476703.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline_en_5.4.2_3.0_1724241476703.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mlsum_domain_specific_paraphraser_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/guidoivetta/mt5-small-mlsum_domain-specific-paraphraser_V1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_nlg_all_crosswoz_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_nlg_all_crosswoz_pipeline_zh.md new file mode 100644 index 00000000000000..51448bb64148a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_nlg_all_crosswoz_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese mt5_small_nlg_all_crosswoz_pipeline pipeline T5Transformer from ConvLab +author: John Snow Labs +name: mt5_small_nlg_all_crosswoz_pipeline +date: 2024-08-21 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nlg_all_crosswoz_pipeline` is a Chinese model originally trained by ConvLab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nlg_all_crosswoz_pipeline_zh_5.4.2_3.0_1724276048227.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nlg_all_crosswoz_pipeline_zh_5.4.2_3.0_1724276048227.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nlg_all_crosswoz_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nlg_all_crosswoz_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nlg_all_crosswoz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ConvLab/mt5-small-nlg-all-crosswoz + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_nlg_all_crosswoz_zh.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_nlg_all_crosswoz_zh.md new file mode 100644 index 00000000000000..ac701eb163676d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_nlg_all_crosswoz_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese mt5_small_nlg_all_crosswoz T5Transformer from ConvLab +author: John Snow Labs +name: mt5_small_nlg_all_crosswoz +date: 2024-08-21 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nlg_all_crosswoz` is a Chinese model originally trained by ConvLab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nlg_all_crosswoz_zh_5.4.2_3.0_1724275854638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nlg_all_crosswoz_zh_5.4.2_3.0_1724275854638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nlg_all_crosswoz","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nlg_all_crosswoz", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nlg_all_crosswoz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ConvLab/mt5-small-nlg-all-crosswoz \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_paracrawl_multi_all_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_paracrawl_multi_all_en.md new file mode 100644 index 00000000000000..219e081cfbf006 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_paracrawl_multi_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_paracrawl_multi_all T5Transformer from yawnick +author: John Snow Labs +name: mt5_small_paracrawl_multi_all +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_paracrawl_multi_all` is a English model originally trained by yawnick. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_multi_all_en_5.4.2_3.0_1724223607873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_multi_all_en_5.4.2_3.0_1724223607873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_paracrawl_multi_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_paracrawl_multi_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_paracrawl_multi_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/yawnick/mt5-small-paracrawl-multi-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_paracrawl_multi_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_paracrawl_multi_all_pipeline_en.md new file mode 100644 index 00000000000000..e6d816fc50f642 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_paracrawl_multi_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_paracrawl_multi_all_pipeline pipeline T5Transformer from yawnick +author: John Snow Labs +name: mt5_small_paracrawl_multi_all_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_paracrawl_multi_all_pipeline` is a English model originally trained by yawnick. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_multi_all_pipeline_en_5.4.2_3.0_1724223695803.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_paracrawl_multi_all_pipeline_en_5.4.2_3.0_1724223695803.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_paracrawl_multi_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_paracrawl_multi_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_paracrawl_multi_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/yawnick/mt5-small-paracrawl-multi-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qg_hl_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qg_hl_en.md new file mode 100644 index 00000000000000..59bee9f437dc03 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qg_hl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_qg_hl T5Transformer from sangrimlee +author: John Snow Labs +name: mt5_small_qg_hl +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_qg_hl` is a English model originally trained by sangrimlee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_qg_hl_en_5.4.2_3.0_1724274501470.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_qg_hl_en_5.4.2_3.0_1724274501470.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_qg_hl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_qg_hl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_qg_hl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sangrimlee/mt5-small-qg-hl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qg_hl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qg_hl_pipeline_en.md new file mode 100644 index 00000000000000..f6c57016c810ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qg_hl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_qg_hl_pipeline pipeline T5Transformer from sangrimlee +author: John Snow Labs +name: mt5_small_qg_hl_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_qg_hl_pipeline` is a English model originally trained by sangrimlee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_qg_hl_pipeline_en_5.4.2_3.0_1724274678100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_qg_hl_pipeline_en_5.4.2_3.0_1724274678100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_qg_hl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_qg_hl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_qg_hl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sangrimlee/mt5-small-qg-hl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qgen_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qgen_pipeline_xx.md new file mode 100644 index 00000000000000..7e11ab6f9d4562 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qgen_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual mt5_small_qgen_pipeline pipeline T5Transformer from nbroad +author: John Snow Labs +name: mt5_small_qgen_pipeline +date: 2024-08-21 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_qgen_pipeline` is a Multilingual model originally trained by nbroad. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_qgen_pipeline_xx_5.4.2_3.0_1724223004190.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_qgen_pipeline_xx_5.4.2_3.0_1724223004190.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_qgen_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_qgen_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_qgen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|1.4 GB| + +## References + +https://huggingface.co/nbroad/mt5-small-qgen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qgen_xx.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qgen_xx.md new file mode 100644 index 00000000000000..8db52bffdfef84 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_qgen_xx.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Multilingual mt5_small_qgen T5Transformer from nbroad +author: John Snow Labs +name: mt5_small_qgen +date: 2024-08-21 +tags: [xx, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_qgen` is a Multilingual model originally trained by nbroad. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_qgen_xx_5.4.2_3.0_1724222880209.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_qgen_xx_5.4.2_3.0_1724222880209.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_qgen","xx") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_qgen", "xx") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_qgen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|1.4 GB| + +## References + +https://huggingface.co/nbroad/mt5-small-qgen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_squad_qa_trimmed_english_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_squad_qa_trimmed_english_en.md new file mode 100644 index 00000000000000..857a7ec98e661b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_squad_qa_trimmed_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_squad_qa_trimmed_english T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qa_trimmed_english +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qa_trimmed_english` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_en_5.4.2_3.0_1724226317050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_en_5.4.2_3.0_1724226317050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_squad_qa_trimmed_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_squad_qa_trimmed_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qa_trimmed_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qa-trimmed-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_squad_qa_trimmed_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_squad_qa_trimmed_english_pipeline_en.md new file mode 100644 index 00000000000000..646978adedac37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_squad_qa_trimmed_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_squad_qa_trimmed_english_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qa_trimmed_english_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qa_trimmed_english_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_pipeline_en_5.4.2_3.0_1724226393694.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qa_trimmed_english_pipeline_en_5.4.2_3.0_1724226393694.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_squad_qa_trimmed_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_squad_qa_trimmed_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qa_trimmed_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qa-trimmed-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_task1_dataset4_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_task1_dataset4_en.md new file mode 100644 index 00000000000000..8f4b1ee44e7b0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_task1_dataset4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_task1_dataset4 T5Transformer from ZhiguangHan +author: John Snow Labs +name: mt5_small_task1_dataset4 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_task1_dataset4` is a English model originally trained by ZhiguangHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_task1_dataset4_en_5.4.2_3.0_1724280062765.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_task1_dataset4_en_5.4.2_3.0_1724280062765.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_task1_dataset4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_task1_dataset4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_task1_dataset4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ZhiguangHan/mt5-small-task1-dataset4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_task1_dataset4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_task1_dataset4_pipeline_en.md new file mode 100644 index 00000000000000..0ace4be84a2a24 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_task1_dataset4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_task1_dataset4_pipeline pipeline T5Transformer from ZhiguangHan +author: John Snow Labs +name: mt5_small_task1_dataset4_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_task1_dataset4_pipeline` is a English model originally trained by ZhiguangHan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_task1_dataset4_pipeline_en_5.4.2_3.0_1724280181235.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_task1_dataset4_pipeline_en_5.4.2_3.0_1724280181235.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_task1_dataset4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_task1_dataset4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_task1_dataset4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ZhiguangHan/mt5-small-task1-dataset4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_torch_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_torch_en.md new file mode 100644 index 00000000000000..fc0db5e4719911 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_torch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_torch T5Transformer from Evuv +author: John Snow Labs +name: mt5_small_torch +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_torch` is a English model originally trained by Evuv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_torch_en_5.4.2_3.0_1724233136053.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_torch_en_5.4.2_3.0_1724233136053.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_torch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_torch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_torch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|4.6 MB| + +## References + +https://huggingface.co/Evuv/mt5-small-torch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_torch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_torch_pipeline_en.md new file mode 100644 index 00000000000000..80e7e647bc7d2f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_torch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_torch_pipeline pipeline T5Transformer from Evuv +author: John Snow Labs +name: mt5_small_torch_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_torch_pipeline` is a English model originally trained by Evuv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_torch_pipeline_en_5.4.2_3.0_1724233142221.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_torch_pipeline_en_5.4.2_3.0_1724233142221.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_torch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_torch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_torch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|4.6 MB| + +## References + +https://huggingface.co/Evuv/mt5-small-torch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_english_10000_squad_qg_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_english_10000_squad_qg_en.md new file mode 100644 index 00000000000000..a3d9e4a71da89c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_english_10000_squad_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_10000_squad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_10000_squad_qg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_10000_squad_qg` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_squad_qg_en_5.4.2_3.0_1724206980309.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_squad_qg_en_5.4.2_3.0_1724206980309.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_10000_squad_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_10000_squad_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_10000_squad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|224.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-10000-squad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_english_10000_squad_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_english_10000_squad_qg_pipeline_en.md new file mode 100644 index 00000000000000..61f604c446f0e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_english_10000_squad_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_10000_squad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_10000_squad_qg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_10000_squad_qg_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_squad_qg_pipeline_en_5.4.2_3.0_1724206992553.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_squad_qg_pipeline_en_5.4.2_3.0_1724206992553.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_10000_squad_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_10000_squad_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_10000_squad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|224.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-10000-squad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_60000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_60000_en.md new file mode 100644 index 00000000000000..9e8f083d36e3b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_japanese_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_60000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_60000_en_5.4.2_3.0_1724270931907.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_60000_en_5.4.2_3.0_1724270931907.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|262.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_60000_pipeline_en.md new file mode 100644 index 00000000000000..b6072952a06a1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_japanese_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_60000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_60000_pipeline_en_5.4.2_3.0_1724271021626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_60000_pipeline_en_5.4.2_3.0_1724271021626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|262.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_jaquad_qa_ja.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_jaquad_qa_ja.md new file mode 100644 index 00000000000000..5fd20b9f27c839 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_jaquad_qa_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_jaquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_jaquad_qa +date: 2024-08-21 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_jaquad_qa` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_jaquad_qa_ja_5.4.2_3.0_1724252114172.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_jaquad_qa_ja_5.4.2_3.0_1724252114172.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_jaquad_qa","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_jaquad_qa", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_jaquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|729.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-jaquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_jaquad_qa_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_jaquad_qa_pipeline_ja.md new file mode 100644 index 00000000000000..403e49cc489b9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_japanese_jaquad_qa_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_jaquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_jaquad_qa_pipeline +date: 2024-08-21 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_jaquad_qa_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_jaquad_qa_pipeline_ja_5.4.2_3.0_1724252163313.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_jaquad_qa_pipeline_ja_5.4.2_3.0_1724252163313.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_jaquad_qa_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_jaquad_qa_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_jaquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|729.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-jaquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_korean_5000_koquad_qa_ko.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_korean_5000_koquad_qa_ko.md new file mode 100644 index 00000000000000..76060ae49337b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_korean_5000_koquad_qa_ko.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Korean mt5_small_trimmed_korean_5000_koquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_5000_koquad_qa +date: 2024-08-21 +tags: [ko, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_5000_koquad_qa` is a Korean model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_5000_koquad_qa_ko_5.4.2_3.0_1724204641749.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_5000_koquad_qa_ko_5.4.2_3.0_1724204641749.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_5000_koquad_qa","ko") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_5000_koquad_qa", "ko") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_5000_koquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ko| +|Size:|195.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-5000-koquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_korean_5000_koquad_qa_pipeline_ko.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_korean_5000_koquad_qa_pipeline_ko.md new file mode 100644 index 00000000000000..8bb00a25af1541 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_korean_5000_koquad_qa_pipeline_ko.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Korean mt5_small_trimmed_korean_5000_koquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_5000_koquad_qa_pipeline +date: 2024-08-21 +tags: [ko, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_5000_koquad_qa_pipeline` is a Korean model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_5000_koquad_qa_pipeline_ko_5.4.2_3.0_1724204651706.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_5000_koquad_qa_pipeline_ko_5.4.2_3.0_1724204651706.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_korean_5000_koquad_qa_pipeline", lang = "ko") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_korean_5000_koquad_qa_pipeline", lang = "ko") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_5000_koquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ko| +|Size:|195.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-5000-koquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_russian_90000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_russian_90000_en.md new file mode 100644 index 00000000000000..5f40b0be5e253f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_russian_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_russian_90000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_90000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_90000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_90000_en_5.4.2_3.0_1724284131980.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_90000_en_5.4.2_3.0_1724284131980.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_russian_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_russian_90000_pipeline_en.md new file mode 100644 index 00000000000000..0266c1afe5e4cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_russian_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_russian_90000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_90000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_90000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_90000_pipeline_en_5.4.2_3.0_1724284252384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_90000_pipeline_en_5.4.2_3.0_1724284252384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_spanish_90000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_spanish_90000_en.md new file mode 100644 index 00000000000000..7dd2d02392b2b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_spanish_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_spanish_90000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_90000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_90000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_90000_en_5.4.2_3.0_1724272727979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_90000_en_5.4.2_3.0_1724272727979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_spanish_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_spanish_90000_pipeline_en.md new file mode 100644 index 00000000000000..e9b3662a216746 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_trimmed_spanish_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_spanish_90000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_90000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_90000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_90000_pipeline_en_5.4.2_3.0_1724272846127.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_90000_pipeline_en_5.4.2_3.0_1724272846127.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_spanish_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_spanish_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_zhquad_qag_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_zhquad_qag_trimmed_50000_en.md new file mode 100644 index 00000000000000..191bba2489065f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_zhquad_qag_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_zhquad_qag_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_zhquad_qag_trimmed_50000 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_zhquad_qag_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_zhquad_qag_trimmed_50000_en_5.4.2_3.0_1724251727291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_zhquad_qag_trimmed_50000_en_5.4.2_3.0_1724251727291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_zhquad_qag_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_zhquad_qag_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_zhquad_qag_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|414.2 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-zhquad-qag-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5_small_zhquad_qag_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_zhquad_qag_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..c5e557ffd3b795 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5_small_zhquad_qag_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_zhquad_qag_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_zhquad_qag_trimmed_50000_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_zhquad_qag_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_zhquad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724251750507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_zhquad_qag_trimmed_50000_pipeline_en_5.4.2_3.0_1724251750507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_zhquad_qag_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_zhquad_qag_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_zhquad_qag_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|414.2 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-zhquad-qag-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5np_mini12l_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5np_mini12l_en.md new file mode 100644 index 00000000000000..d1ddafb27174c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5np_mini12l_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5np_mini12l T5Transformer from kkuramitsu +author: John Snow Labs +name: mt5np_mini12l +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5np_mini12l` is a English model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5np_mini12l_en_5.4.2_3.0_1724237434539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5np_mini12l_en_5.4.2_3.0_1724237434539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5np_mini12l","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5np_mini12l", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5np_mini12l| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|216.5 MB| + +## References + +https://huggingface.co/kkuramitsu/mt5np_mini12L \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-mt5np_mini12l_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-mt5np_mini12l_pipeline_en.md new file mode 100644 index 00000000000000..a667a8f5c14918 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-mt5np_mini12l_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5np_mini12l_pipeline pipeline T5Transformer from kkuramitsu +author: John Snow Labs +name: mt5np_mini12l_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5np_mini12l_pipeline` is a English model originally trained by kkuramitsu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5np_mini12l_pipeline_en_5.4.2_3.0_1724237445324.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5np_mini12l_pipeline_en_5.4.2_3.0_1724237445324.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5np_mini12l_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5np_mini12l_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5np_mini12l_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|216.5 MB| + +## References + +https://huggingface.co/kkuramitsu/mt5np_mini12L + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-multi_doc_sum_t5_slide_norwegian_prompt_en.md b/docs/_posts/ahmedlone127/2024-08-21-multi_doc_sum_t5_slide_norwegian_prompt_en.md new file mode 100644 index 00000000000000..99559b3b8e1cc3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-multi_doc_sum_t5_slide_norwegian_prompt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English multi_doc_sum_t5_slide_norwegian_prompt T5Transformer from whu9 +author: John Snow Labs +name: multi_doc_sum_t5_slide_norwegian_prompt +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multi_doc_sum_t5_slide_norwegian_prompt` is a English model originally trained by whu9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multi_doc_sum_t5_slide_norwegian_prompt_en_5.4.2_3.0_1724280096226.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multi_doc_sum_t5_slide_norwegian_prompt_en_5.4.2_3.0_1724280096226.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("multi_doc_sum_t5_slide_norwegian_prompt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("multi_doc_sum_t5_slide_norwegian_prompt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multi_doc_sum_t5_slide_norwegian_prompt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|225.2 MB| + +## References + +https://huggingface.co/whu9/multi_doc_sum_t5_slide_no_prompt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-multi_doc_sum_t5_slide_norwegian_prompt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-multi_doc_sum_t5_slide_norwegian_prompt_pipeline_en.md new file mode 100644 index 00000000000000..41da4855fbefe6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-multi_doc_sum_t5_slide_norwegian_prompt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English multi_doc_sum_t5_slide_norwegian_prompt_pipeline pipeline T5Transformer from whu9 +author: John Snow Labs +name: multi_doc_sum_t5_slide_norwegian_prompt_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multi_doc_sum_t5_slide_norwegian_prompt_pipeline` is a English model originally trained by whu9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multi_doc_sum_t5_slide_norwegian_prompt_pipeline_en_5.4.2_3.0_1724280144187.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multi_doc_sum_t5_slide_norwegian_prompt_pipeline_en_5.4.2_3.0_1724280144187.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("multi_doc_sum_t5_slide_norwegian_prompt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("multi_doc_sum_t5_slide_norwegian_prompt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multi_doc_sum_t5_slide_norwegian_prompt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|225.2 MB| + +## References + +https://huggingface.co/whu9/multi_doc_sum_t5_slide_no_prompt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-news2topic_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-news2topic_t5_base_en.md new file mode 100644 index 00000000000000..64089928e2fc0c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-news2topic_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English news2topic_t5_base T5Transformer from textgain +author: John Snow Labs +name: news2topic_t5_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`news2topic_t5_base` is a English model originally trained by textgain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/news2topic_t5_base_en_5.4.2_3.0_1724254825054.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/news2topic_t5_base_en_5.4.2_3.0_1724254825054.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("news2topic_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("news2topic_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|news2topic_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/textgain/News2Topic-T5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-news2topic_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-news2topic_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..3f085435427f13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-news2topic_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English news2topic_t5_base_pipeline pipeline T5Transformer from textgain +author: John Snow Labs +name: news2topic_t5_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`news2topic_t5_base_pipeline` is a English model originally trained by textgain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/news2topic_t5_base_pipeline_en_5.4.2_3.0_1724254885573.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/news2topic_t5_base_pipeline_en_5.4.2_3.0_1724254885573.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("news2topic_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("news2topic_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|news2topic_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/textgain/News2Topic-T5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-nlge24mixed_en.md b/docs/_posts/ahmedlone127/2024-08-21-nlge24mixed_en.md new file mode 100644 index 00000000000000..60c53120afb69a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-nlge24mixed_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nlge24mixed T5Transformer from Bistolero +author: John Snow Labs +name: nlge24mixed +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nlge24mixed` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nlge24mixed_en_5.4.2_3.0_1724241579175.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nlge24mixed_en_5.4.2_3.0_1724241579175.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nlge24mixed","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nlge24mixed", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nlge24mixed| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/nlge24mixed \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-nlge24mixed_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-nlge24mixed_pipeline_en.md new file mode 100644 index 00000000000000..fa156aa451dae0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-nlge24mixed_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nlge24mixed_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: nlge24mixed_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nlge24mixed_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nlge24mixed_pipeline_en_5.4.2_3.0_1724241742208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nlge24mixed_pipeline_en_5.4.2_3.0_1724241742208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nlge24mixed_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nlge24mixed_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nlge24mixed_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/nlge24mixed + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-norwegian_sum_t5_4_en.md b/docs/_posts/ahmedlone127/2024-08-21-norwegian_sum_t5_4_en.md new file mode 100644 index 00000000000000..d53f8a67b14052 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-norwegian_sum_t5_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English norwegian_sum_t5_4 T5Transformer from alraisi +author: John Snow Labs +name: norwegian_sum_t5_4 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_sum_t5_4` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_4_en_5.4.2_3.0_1724202307362.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_4_en_5.4.2_3.0_1724202307362.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("norwegian_sum_t5_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("norwegian_sum_t5_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_sum_t5_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|343.2 MB| + +## References + +https://huggingface.co/alraisi/no-sum-t5-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-norwegian_sum_t5_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-norwegian_sum_t5_4_pipeline_en.md new file mode 100644 index 00000000000000..448d384cbdf971 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-norwegian_sum_t5_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English norwegian_sum_t5_4_pipeline pipeline T5Transformer from alraisi +author: John Snow Labs +name: norwegian_sum_t5_4_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_sum_t5_4_pipeline` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_4_pipeline_en_5.4.2_3.0_1724202325698.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_sum_t5_4_pipeline_en_5.4.2_3.0_1724202325698.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("norwegian_sum_t5_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("norwegian_sum_t5_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_sum_t5_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|343.2 MB| + +## References + +https://huggingface.co/alraisi/no-sum-t5-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-notation_naming_model_en.md b/docs/_posts/ahmedlone127/2024-08-21-notation_naming_model_en.md new file mode 100644 index 00000000000000..17d25ed1933108 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-notation_naming_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English notation_naming_model T5Transformer from hyunjongkimmath +author: John Snow Labs +name: notation_naming_model +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`notation_naming_model` is a English model originally trained by hyunjongkimmath. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/notation_naming_model_en_5.4.2_3.0_1724258302392.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/notation_naming_model_en_5.4.2_3.0_1724258302392.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("notation_naming_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("notation_naming_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|notation_naming_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.3 MB| + +## References + +https://huggingface.co/hyunjongkimmath/notation_naming_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-notation_naming_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-notation_naming_model_pipeline_en.md new file mode 100644 index 00000000000000..2289e47ff999cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-notation_naming_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English notation_naming_model_pipeline pipeline T5Transformer from hyunjongkimmath +author: John Snow Labs +name: notation_naming_model_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`notation_naming_model_pipeline` is a English model originally trained by hyunjongkimmath. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/notation_naming_model_pipeline_en_5.4.2_3.0_1724258327981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/notation_naming_model_pipeline_en_5.4.2_3.0_1724258327981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("notation_naming_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("notation_naming_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|notation_naming_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.3 MB| + +## References + +https://huggingface.co/hyunjongkimmath/notation_naming_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-paraphraser_german_mt5_small_de.md b/docs/_posts/ahmedlone127/2024-08-21-paraphraser_german_mt5_small_de.md new file mode 100644 index 00000000000000..d3f18a3d77b85c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-paraphraser_german_mt5_small_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German paraphraser_german_mt5_small T5Transformer from milyiyo +author: John Snow Labs +name: paraphraser_german_mt5_small +date: 2024-08-21 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`paraphraser_german_mt5_small` is a German model originally trained by milyiyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/paraphraser_german_mt5_small_de_5.4.2_3.0_1724222887014.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/paraphraser_german_mt5_small_de_5.4.2_3.0_1724222887014.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("paraphraser_german_mt5_small","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("paraphraser_german_mt5_small", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|paraphraser_german_mt5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|1.2 GB| + +## References + +https://huggingface.co/milyiyo/paraphraser-german-mt5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-paraphraser_german_mt5_small_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-21-paraphraser_german_mt5_small_pipeline_de.md new file mode 100644 index 00000000000000..a155b9abae0bf7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-paraphraser_german_mt5_small_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German paraphraser_german_mt5_small_pipeline pipeline T5Transformer from milyiyo +author: John Snow Labs +name: paraphraser_german_mt5_small_pipeline +date: 2024-08-21 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`paraphraser_german_mt5_small_pipeline` is a German model originally trained by milyiyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/paraphraser_german_mt5_small_pipeline_de_5.4.2_3.0_1724223070192.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/paraphraser_german_mt5_small_pipeline_de_5.4.2_3.0_1724223070192.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("paraphraser_german_mt5_small_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("paraphraser_german_mt5_small_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|paraphraser_german_mt5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|1.2 GB| + +## References + +https://huggingface.co/milyiyo/paraphraser-german-mt5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-passive_tonga_tonga_islands_active_jaimin_en.md b/docs/_posts/ahmedlone127/2024-08-21-passive_tonga_tonga_islands_active_jaimin_en.md new file mode 100644 index 00000000000000..cc372c8af27b19 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-passive_tonga_tonga_islands_active_jaimin_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English passive_tonga_tonga_islands_active_jaimin T5Transformer from jaimin +author: John Snow Labs +name: passive_tonga_tonga_islands_active_jaimin +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`passive_tonga_tonga_islands_active_jaimin` is a English model originally trained by jaimin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/passive_tonga_tonga_islands_active_jaimin_en_5.4.2_3.0_1724222283852.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/passive_tonga_tonga_islands_active_jaimin_en_5.4.2_3.0_1724222283852.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("passive_tonga_tonga_islands_active_jaimin","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("passive_tonga_tonga_islands_active_jaimin", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|passive_tonga_tonga_islands_active_jaimin| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|315.1 MB| + +## References + +https://huggingface.co/jaimin/Passive_to_active \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-passive_tonga_tonga_islands_active_jaimin_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-passive_tonga_tonga_islands_active_jaimin_pipeline_en.md new file mode 100644 index 00000000000000..e178eab95ea931 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-passive_tonga_tonga_islands_active_jaimin_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English passive_tonga_tonga_islands_active_jaimin_pipeline pipeline T5Transformer from jaimin +author: John Snow Labs +name: passive_tonga_tonga_islands_active_jaimin_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`passive_tonga_tonga_islands_active_jaimin_pipeline` is a English model originally trained by jaimin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/passive_tonga_tonga_islands_active_jaimin_pipeline_en_5.4.2_3.0_1724222303630.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/passive_tonga_tonga_islands_active_jaimin_pipeline_en_5.4.2_3.0_1724222303630.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("passive_tonga_tonga_islands_active_jaimin_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("passive_tonga_tonga_islands_active_jaimin_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|passive_tonga_tonga_islands_active_jaimin_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|315.1 MB| + +## References + +https://huggingface.co/jaimin/Passive_to_active + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-peft_flan_t5_mc_question_generation_eduqg_en.md b/docs/_posts/ahmedlone127/2024-08-21-peft_flan_t5_mc_question_generation_eduqg_en.md new file mode 100644 index 00000000000000..12970a02d0583a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-peft_flan_t5_mc_question_generation_eduqg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English peft_flan_t5_mc_question_generation_eduqg T5Transformer from Michelvh +author: John Snow Labs +name: peft_flan_t5_mc_question_generation_eduqg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`peft_flan_t5_mc_question_generation_eduqg` is a English model originally trained by Michelvh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/peft_flan_t5_mc_question_generation_eduqg_en_5.4.2_3.0_1724210898422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/peft_flan_t5_mc_question_generation_eduqg_en_5.4.2_3.0_1724210898422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("peft_flan_t5_mc_question_generation_eduqg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("peft_flan_t5_mc_question_generation_eduqg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|peft_flan_t5_mc_question_generation_eduqg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|700.8 MB| + +## References + +https://huggingface.co/Michelvh/peft-flan-t5-mc-question-generation-eduqg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-peft_flan_t5_mc_question_generation_eduqg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-peft_flan_t5_mc_question_generation_eduqg_pipeline_en.md new file mode 100644 index 00000000000000..bda918f56af32a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-peft_flan_t5_mc_question_generation_eduqg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English peft_flan_t5_mc_question_generation_eduqg_pipeline pipeline T5Transformer from Michelvh +author: John Snow Labs +name: peft_flan_t5_mc_question_generation_eduqg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`peft_flan_t5_mc_question_generation_eduqg_pipeline` is a English model originally trained by Michelvh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/peft_flan_t5_mc_question_generation_eduqg_pipeline_en_5.4.2_3.0_1724211070646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/peft_flan_t5_mc_question_generation_eduqg_pipeline_en_5.4.2_3.0_1724211070646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("peft_flan_t5_mc_question_generation_eduqg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("peft_flan_t5_mc_question_generation_eduqg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|peft_flan_t5_mc_question_generation_eduqg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|700.8 MB| + +## References + +https://huggingface.co/Michelvh/peft-flan-t5-mc-question-generation-eduqg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-persian_farsi_t5_base_fa.md b/docs/_posts/ahmedlone127/2024-08-21-persian_farsi_t5_base_fa.md new file mode 100644 index 00000000000000..242aa1003d53c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-persian_farsi_t5_base_fa.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Persian persian_farsi_t5_base T5Transformer from alighasemi +author: John Snow Labs +name: persian_farsi_t5_base +date: 2024-08-21 +tags: [fa, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fa +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`persian_farsi_t5_base` is a Persian model originally trained by alighasemi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/persian_farsi_t5_base_fa_5.4.2_3.0_1724257247008.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/persian_farsi_t5_base_fa_5.4.2_3.0_1724257247008.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("persian_farsi_t5_base","fa") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("persian_farsi_t5_base", "fa") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|persian_farsi_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fa| +|Size:|511.6 MB| + +## References + +https://huggingface.co/alighasemi/fa-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-persian_farsi_t5_base_pipeline_fa.md b/docs/_posts/ahmedlone127/2024-08-21-persian_farsi_t5_base_pipeline_fa.md new file mode 100644 index 00000000000000..d7e2931e24e8d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-persian_farsi_t5_base_pipeline_fa.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Persian persian_farsi_t5_base_pipeline pipeline T5Transformer from alighasemi +author: John Snow Labs +name: persian_farsi_t5_base_pipeline +date: 2024-08-21 +tags: [fa, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fa +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`persian_farsi_t5_base_pipeline` is a Persian model originally trained by alighasemi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/persian_farsi_t5_base_pipeline_fa_5.4.2_3.0_1724257423864.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/persian_farsi_t5_base_pipeline_fa_5.4.2_3.0_1724257423864.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("persian_farsi_t5_base_pipeline", lang = "fa") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("persian_farsi_t5_base_pipeline", lang = "fa") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|persian_farsi_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fa| +|Size:|511.6 MB| + +## References + +https://huggingface.co/alighasemi/fa-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-polyglotiq_mt5_lang_detect_en.md b/docs/_posts/ahmedlone127/2024-08-21-polyglotiq_mt5_lang_detect_en.md new file mode 100644 index 00000000000000..d28b0b2ddbbda1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-polyglotiq_mt5_lang_detect_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English polyglotiq_mt5_lang_detect T5Transformer from AnonymousArt +author: John Snow Labs +name: polyglotiq_mt5_lang_detect +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polyglotiq_mt5_lang_detect` is a English model originally trained by AnonymousArt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polyglotiq_mt5_lang_detect_en_5.4.2_3.0_1724246338643.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polyglotiq_mt5_lang_detect_en_5.4.2_3.0_1724246338643.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("polyglotiq_mt5_lang_detect","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("polyglotiq_mt5_lang_detect", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polyglotiq_mt5_lang_detect| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/AnonymousArt/PolyglotIQ_mt5_lang_detect \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-polyglotiq_mt5_lang_detect_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-polyglotiq_mt5_lang_detect_pipeline_en.md new file mode 100644 index 00000000000000..a0dc99057ca082 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-polyglotiq_mt5_lang_detect_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English polyglotiq_mt5_lang_detect_pipeline pipeline T5Transformer from AnonymousArt +author: John Snow Labs +name: polyglotiq_mt5_lang_detect_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polyglotiq_mt5_lang_detect_pipeline` is a English model originally trained by AnonymousArt. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polyglotiq_mt5_lang_detect_pipeline_en_5.4.2_3.0_1724246428627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polyglotiq_mt5_lang_detect_pipeline_en_5.4.2_3.0_1724246428627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("polyglotiq_mt5_lang_detect_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("polyglotiq_mt5_lang_detect_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polyglotiq_mt5_lang_detect_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/AnonymousArt/PolyglotIQ_mt5_lang_detect + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-pretrained_t5_polymer_composite_caption_en.md b/docs/_posts/ahmedlone127/2024-08-21-pretrained_t5_polymer_composite_caption_en.md new file mode 100644 index 00000000000000..5eb9f3418e40e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-pretrained_t5_polymer_composite_caption_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pretrained_t5_polymer_composite_caption T5Transformer from bingyinh +author: John Snow Labs +name: pretrained_t5_polymer_composite_caption +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pretrained_t5_polymer_composite_caption` is a English model originally trained by bingyinh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pretrained_t5_polymer_composite_caption_en_5.4.2_3.0_1724259779831.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pretrained_t5_polymer_composite_caption_en_5.4.2_3.0_1724259779831.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pretrained_t5_polymer_composite_caption","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pretrained_t5_polymer_composite_caption", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pretrained_t5_polymer_composite_caption| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bingyinh/pretrained_t5_polymer_composite_caption \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-pretrained_t5_polymer_composite_caption_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-pretrained_t5_polymer_composite_caption_pipeline_en.md new file mode 100644 index 00000000000000..bedc546b437dfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-pretrained_t5_polymer_composite_caption_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pretrained_t5_polymer_composite_caption_pipeline pipeline T5Transformer from bingyinh +author: John Snow Labs +name: pretrained_t5_polymer_composite_caption_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pretrained_t5_polymer_composite_caption_pipeline` is a English model originally trained by bingyinh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pretrained_t5_polymer_composite_caption_pipeline_en_5.4.2_3.0_1724259828540.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pretrained_t5_polymer_composite_caption_pipeline_en_5.4.2_3.0_1724259828540.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pretrained_t5_polymer_composite_caption_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pretrained_t5_polymer_composite_caption_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pretrained_t5_polymer_composite_caption_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bingyinh/pretrained_t5_polymer_composite_caption + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-promptclue_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-promptclue_base_en.md new file mode 100644 index 00000000000000..f39ba0ab53b8f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-promptclue_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English promptclue_base T5Transformer from pe65374 +author: John Snow Labs +name: promptclue_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`promptclue_base` is a English model originally trained by pe65374. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/promptclue_base_en_5.4.2_3.0_1724227693514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/promptclue_base_en_5.4.2_3.0_1724227693514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("promptclue_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("promptclue_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|promptclue_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.9 MB| + +## References + +https://huggingface.co/pe65374/PromptCLUE-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-promptclue_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-promptclue_base_pipeline_en.md new file mode 100644 index 00000000000000..de9fcbd4da34d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-promptclue_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English promptclue_base_pipeline pipeline T5Transformer from pe65374 +author: John Snow Labs +name: promptclue_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`promptclue_base_pipeline` is a English model originally trained by pe65374. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/promptclue_base_pipeline_en_5.4.2_3.0_1724227874692.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/promptclue_base_pipeline_en_5.4.2_3.0_1724227874692.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("promptclue_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("promptclue_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|promptclue_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.9 MB| + +## References + +https://huggingface.co/pe65374/PromptCLUE-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-pruebapln_en.md b/docs/_posts/ahmedlone127/2024-08-21-pruebapln_en.md new file mode 100644 index 00000000000000..11c63ccfc0727f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-pruebapln_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pruebapln T5Transformer from Jefferson +author: John Snow Labs +name: pruebapln +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pruebapln` is a English model originally trained by Jefferson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pruebapln_en_5.4.2_3.0_1724275310212.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pruebapln_en_5.4.2_3.0_1724275310212.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pruebapln","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pruebapln", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pruebapln| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|949.4 MB| + +## References + +https://huggingface.co/Jefferson/PruebaPLN \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-pruebapln_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-pruebapln_pipeline_en.md new file mode 100644 index 00000000000000..1213fc49479906 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-pruebapln_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pruebapln_pipeline pipeline T5Transformer from Jefferson +author: John Snow Labs +name: pruebapln_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pruebapln_pipeline` is a English model originally trained by Jefferson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pruebapln_pipeline_en_5.4.2_3.0_1724275369675.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pruebapln_pipeline_en_5.4.2_3.0_1724275369675.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pruebapln_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pruebapln_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pruebapln_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|949.4 MB| + +## References + +https://huggingface.co/Jefferson/PruebaPLN + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-pruned_mt5_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-pruned_mt5_base_en.md new file mode 100644 index 00000000000000..5cdaff9c0d4c5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-pruned_mt5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pruned_mt5_base T5Transformer from X-Wang +author: John Snow Labs +name: pruned_mt5_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pruned_mt5_base` is a English model originally trained by X-Wang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pruned_mt5_base_en_5.4.2_3.0_1724219945615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pruned_mt5_base_en_5.4.2_3.0_1724219945615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pruned_mt5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pruned_mt5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pruned_mt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|557.7 MB| + +## References + +https://huggingface.co/X-Wang/pruned_mt5_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-pruned_mt5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-pruned_mt5_base_pipeline_en.md new file mode 100644 index 00000000000000..2e6e472f5ac1a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-pruned_mt5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pruned_mt5_base_pipeline pipeline T5Transformer from X-Wang +author: John Snow Labs +name: pruned_mt5_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pruned_mt5_base_pipeline` is a English model originally trained by X-Wang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pruned_mt5_base_pipeline_en_5.4.2_3.0_1724220133345.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pruned_mt5_base_pipeline_en_5.4.2_3.0_1724220133345.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pruned_mt5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pruned_mt5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pruned_mt5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|557.7 MB| + +## References + +https://huggingface.co/X-Wang/pruned_mt5_base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_cstnews_1024_en.md b/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_cstnews_1024_en.md new file mode 100644 index 00000000000000..a63f063f211c70 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_cstnews_1024_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ptt5_xlsumm_cstnews_1024 T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_xlsumm_cstnews_1024 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_xlsumm_cstnews_1024` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_cstnews_1024_en_5.4.2_3.0_1724261994442.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_cstnews_1024_en_5.4.2_3.0_1724261994442.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_xlsumm_cstnews_1024","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_xlsumm_cstnews_1024", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_xlsumm_cstnews_1024| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.2 MB| + +## References + +https://huggingface.co/arthurmluz/ptt5-xlsumm-cstnews-1024 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_cstnews_1024_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_cstnews_1024_pipeline_en.md new file mode 100644 index 00000000000000..05a27a7b32c87a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_cstnews_1024_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ptt5_xlsumm_cstnews_1024_pipeline pipeline T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_xlsumm_cstnews_1024_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_xlsumm_cstnews_1024_pipeline` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_cstnews_1024_pipeline_en_5.4.2_3.0_1724262045377.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_cstnews_1024_pipeline_en_5.4.2_3.0_1724262045377.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_xlsumm_cstnews_1024_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_xlsumm_cstnews_1024_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_xlsumm_cstnews_1024_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.2 MB| + +## References + +https://huggingface.co/arthurmluz/ptt5-xlsumm-cstnews-1024 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_gptextsum_en.md b/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_gptextsum_en.md new file mode 100644 index 00000000000000..4ee792a50afc3e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_gptextsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ptt5_xlsumm_gptextsum T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_xlsumm_gptextsum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_xlsumm_gptextsum` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_gptextsum_en_5.4.2_3.0_1724270642197.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_gptextsum_en_5.4.2_3.0_1724270642197.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ptt5_xlsumm_gptextsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ptt5_xlsumm_gptextsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_xlsumm_gptextsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.3 MB| + +## References + +https://huggingface.co/arthurmluz/ptt5-xlsumm-gptextsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_gptextsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_gptextsum_pipeline_en.md new file mode 100644 index 00000000000000..9e1422498ba6fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-ptt5_xlsumm_gptextsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ptt5_xlsumm_gptextsum_pipeline pipeline T5Transformer from arthurmluz +author: John Snow Labs +name: ptt5_xlsumm_gptextsum_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ptt5_xlsumm_gptextsum_pipeline` is a English model originally trained by arthurmluz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_gptextsum_pipeline_en_5.4.2_3.0_1724270692138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ptt5_xlsumm_gptextsum_pipeline_en_5.4.2_3.0_1724270692138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ptt5_xlsumm_gptextsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ptt5_xlsumm_gptextsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ptt5_xlsumm_gptextsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.3 MB| + +## References + +https://huggingface.co/arthurmluz/ptt5-xlsumm-gptextsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-q2q_paq_en.md b/docs/_posts/ahmedlone127/2024-08-21-q2q_paq_en.md new file mode 100644 index 00000000000000..3d05330231e2b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-q2q_paq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English q2q_paq T5Transformer from Soyoung97 +author: John Snow Labs +name: q2q_paq +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`q2q_paq` is a English model originally trained by Soyoung97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/q2q_paq_en_5.4.2_3.0_1724203974928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/q2q_paq_en_5.4.2_3.0_1724203974928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("q2q_paq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("q2q_paq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|q2q_paq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/Soyoung97/q2q_paq \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-qnli_t5_base_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-21-qnli_t5_base_seed_1_en.md new file mode 100644 index 00000000000000..bed00e930309b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-qnli_t5_base_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qnli_t5_base_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: qnli_t5_base_seed_1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qnli_t5_base_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qnli_t5_base_seed_1_en_5.4.2_3.0_1724275641512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qnli_t5_base_seed_1_en_5.4.2_3.0_1724275641512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qnli_t5_base_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qnli_t5_base_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qnli_t5_base_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|981.4 MB| + +## References + +https://huggingface.co/utahnlp/qnli_t5-base_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-qnli_t5_base_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-qnli_t5_base_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..ccb13d99be4430 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-qnli_t5_base_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qnli_t5_base_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: qnli_t5_base_seed_1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qnli_t5_base_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qnli_t5_base_seed_1_pipeline_en_5.4.2_3.0_1724275696943.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qnli_t5_base_seed_1_pipeline_en_5.4.2_3.0_1724275696943.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qnli_t5_base_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qnli_t5_base_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qnli_t5_base_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|981.4 MB| + +## References + +https://huggingface.co/utahnlp/qnli_t5-base_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-question_generator_mohamedemam_en.md b/docs/_posts/ahmedlone127/2024-08-21-question_generator_mohamedemam_en.md new file mode 100644 index 00000000000000..f8d445cdede128 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-question_generator_mohamedemam_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English question_generator_mohamedemam T5Transformer from mohamedemam +author: John Snow Labs +name: question_generator_mohamedemam +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`question_generator_mohamedemam` is a English model originally trained by mohamedemam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/question_generator_mohamedemam_en_5.4.2_3.0_1724220853551.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/question_generator_mohamedemam_en_5.4.2_3.0_1724220853551.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("question_generator_mohamedemam","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("question_generator_mohamedemam", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|question_generator_mohamedemam| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/mohamedemam/Question_generator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-question_generator_mohamedemam_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-question_generator_mohamedemam_pipeline_en.md new file mode 100644 index 00000000000000..ae649377dded5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-question_generator_mohamedemam_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English question_generator_mohamedemam_pipeline pipeline T5Transformer from mohamedemam +author: John Snow Labs +name: question_generator_mohamedemam_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`question_generator_mohamedemam_pipeline` is a English model originally trained by mohamedemam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/question_generator_mohamedemam_pipeline_en_5.4.2_3.0_1724220996185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/question_generator_mohamedemam_pipeline_en_5.4.2_3.0_1724220996185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("question_generator_mohamedemam_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("question_generator_mohamedemam_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|question_generator_mohamedemam_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/mohamedemam/Question_generator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-r0_contribution_ie_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-r0_contribution_ie_pipeline_en.md new file mode 100644 index 00000000000000..b071e3fb47129e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-r0_contribution_ie_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English r0_contribution_ie_pipeline pipeline T5Transformer from orkg +author: John Snow Labs +name: r0_contribution_ie_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`r0_contribution_ie_pipeline` is a English model originally trained by orkg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/r0_contribution_ie_pipeline_en_5.4.2_3.0_1724217441742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/r0_contribution_ie_pipeline_en_5.4.2_3.0_1724217441742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("r0_contribution_ie_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("r0_contribution_ie_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|r0_contribution_ie_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/orkg/R0_contribution_IE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-race_en.md b/docs/_posts/ahmedlone127/2024-08-21-race_en.md new file mode 100644 index 00000000000000..64f3217601ca33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-race_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English race T5Transformer from Rhasan97 +author: John Snow Labs +name: race +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`race` is a English model originally trained by Rhasan97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/race_en_5.4.2_3.0_1724253363128.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/race_en_5.4.2_3.0_1724253363128.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("race","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("race", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|race| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.3 MB| + +## References + +https://huggingface.co/Rhasan97/Race \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-race_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-race_pipeline_en.md new file mode 100644 index 00000000000000..6ed635284f3347 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-race_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English race_pipeline pipeline T5Transformer from Rhasan97 +author: John Snow Labs +name: race_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`race_pipeline` is a English model originally trained by Rhasan97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/race_pipeline_en_5.4.2_3.0_1724253382938.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/race_pipeline_en_5.4.2_3.0_1724253382938.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("race_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("race_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|race_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.3 MB| + +## References + +https://huggingface.co/Rhasan97/Race + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_en.md b/docs/_posts/ahmedlone127/2024-08-21-redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_en.md new file mode 100644 index 00000000000000..2ff2d9b1ee38d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex T5Transformer from rymaju +author: John Snow Labs +name: redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_en_5.4.2_3.0_1724225454848.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_en_5.4.2_3.0_1724225454848.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/rymaju/Redex-NL-RX-Synth-t5-small-finetuned-en-to-regex-finetuned-en-to-regex \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md new file mode 100644 index 00000000000000..8101fb9a4e1269 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline pipeline T5Transformer from rymaju +author: John Snow Labs +name: redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline_en_5.4.2_3.0_1724225471817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline_en_5.4.2_3.0_1724225471817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|redex_dutch_rx_synth_t5_small_finetuned_english_tonga_tonga_islands_regex_finetuned_english_tonga_tonga_islands_regex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/rymaju/Redex-NL-RX-Synth-t5-small-finetuned-en-to-regex-finetuned-en-to-regex + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-redex_t5_small_finetuned_english_tonga_tonga_islands_regex_en.md b/docs/_posts/ahmedlone127/2024-08-21-redex_t5_small_finetuned_english_tonga_tonga_islands_regex_en.md new file mode 100644 index 00000000000000..ae9a8c7744289f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-redex_t5_small_finetuned_english_tonga_tonga_islands_regex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English redex_t5_small_finetuned_english_tonga_tonga_islands_regex T5Transformer from rymaju +author: John Snow Labs +name: redex_t5_small_finetuned_english_tonga_tonga_islands_regex +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`redex_t5_small_finetuned_english_tonga_tonga_islands_regex` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/redex_t5_small_finetuned_english_tonga_tonga_islands_regex_en_5.4.2_3.0_1724281251527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/redex_t5_small_finetuned_english_tonga_tonga_islands_regex_en_5.4.2_3.0_1724281251527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("redex_t5_small_finetuned_english_tonga_tonga_islands_regex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("redex_t5_small_finetuned_english_tonga_tonga_islands_regex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|redex_t5_small_finetuned_english_tonga_tonga_islands_regex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.6 MB| + +## References + +https://huggingface.co/rymaju/Redex-t5-small-finetuned-en-to-regex \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md new file mode 100644 index 00000000000000..a616a69a7f56b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline pipeline T5Transformer from rymaju +author: John Snow Labs +name: redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en_5.4.2_3.0_1724281267940.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en_5.4.2_3.0_1724281267940.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|redex_t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.6 MB| + +## References + +https://huggingface.co/rymaju/Redex-t5-small-finetuned-en-to-regex + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-results_ativilambit_en.md b/docs/_posts/ahmedlone127/2024-08-21-results_ativilambit_en.md new file mode 100644 index 00000000000000..43a03fe58d341a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-results_ativilambit_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English results_ativilambit T5Transformer from ativilambit +author: John Snow Labs +name: results_ativilambit +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_ativilambit` is a English model originally trained by ativilambit. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_ativilambit_en_5.4.2_3.0_1724247025347.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_ativilambit_en_5.4.2_3.0_1724247025347.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("results_ativilambit","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("results_ativilambit", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_ativilambit| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ativilambit/results \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-results_ativilambit_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-results_ativilambit_pipeline_en.md new file mode 100644 index 00000000000000..88ff9baf86c7a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-results_ativilambit_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English results_ativilambit_pipeline pipeline T5Transformer from ativilambit +author: John Snow Labs +name: results_ativilambit_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_ativilambit_pipeline` is a English model originally trained by ativilambit. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_ativilambit_pipeline_en_5.4.2_3.0_1724247072822.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_ativilambit_pipeline_en_5.4.2_3.0_1724247072822.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("results_ativilambit_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("results_ativilambit_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_ativilambit_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ativilambit/results + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-russian_t5absum_for_legaltext_en.md b/docs/_posts/ahmedlone127/2024-08-21-russian_t5absum_for_legaltext_en.md new file mode 100644 index 00000000000000..b97ddc2ad8197f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-russian_t5absum_for_legaltext_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English russian_t5absum_for_legaltext T5Transformer from marcus2000 +author: John Snow Labs +name: russian_t5absum_for_legaltext +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`russian_t5absum_for_legaltext` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/russian_t5absum_for_legaltext_en_5.4.2_3.0_1724236725056.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/russian_t5absum_for_legaltext_en_5.4.2_3.0_1724236725056.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("russian_t5absum_for_legaltext","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("russian_t5absum_for_legaltext", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|russian_t5absum_for_legaltext| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|996.4 MB| + +## References + +https://huggingface.co/marcus2000/ru_t5absum_for_legaltext \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-russian_t5absum_for_legaltext_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-russian_t5absum_for_legaltext_pipeline_en.md new file mode 100644 index 00000000000000..902c58308dd776 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-russian_t5absum_for_legaltext_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English russian_t5absum_for_legaltext_pipeline pipeline T5Transformer from marcus2000 +author: John Snow Labs +name: russian_t5absum_for_legaltext_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`russian_t5absum_for_legaltext_pipeline` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/russian_t5absum_for_legaltext_pipeline_en_5.4.2_3.0_1724236780104.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/russian_t5absum_for_legaltext_pipeline_en_5.4.2_3.0_1724236780104.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("russian_t5absum_for_legaltext_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("russian_t5absum_for_legaltext_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|russian_t5absum_for_legaltext_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|996.4 MB| + +## References + +https://huggingface.co/marcus2000/ru_t5absum_for_legaltext + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-rut5_base_sum_gazeta_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-21-rut5_base_sum_gazeta_finetuned_en.md new file mode 100644 index 00000000000000..3ea0d265ff8f0f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-rut5_base_sum_gazeta_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_sum_gazeta_finetuned T5Transformer from Natet +author: John Snow Labs +name: rut5_base_sum_gazeta_finetuned +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_sum_gazeta_finetuned` is a English model originally trained by Natet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_en_5.4.2_3.0_1724219978243.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_en_5.4.2_3.0_1724219978243.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_sum_gazeta_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_sum_gazeta_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_sum_gazeta_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|992.9 MB| + +## References + +https://huggingface.co/Natet/rut5_base_sum_gazeta-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-rut5_base_sum_gazeta_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-rut5_base_sum_gazeta_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..ed34e73783c68d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-rut5_base_sum_gazeta_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_sum_gazeta_finetuned_pipeline pipeline T5Transformer from Natet +author: John Snow Labs +name: rut5_base_sum_gazeta_finetuned_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_sum_gazeta_finetuned_pipeline` is a English model originally trained by Natet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_pipeline_en_5.4.2_3.0_1724220024537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_sum_gazeta_finetuned_pipeline_en_5.4.2_3.0_1724220024537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_sum_gazeta_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_sum_gazeta_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_sum_gazeta_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|992.9 MB| + +## References + +https://huggingface.co/Natet/rut5_base_sum_gazeta-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-rut5_small_interpreter_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-21-rut5_small_interpreter_pipeline_ru.md new file mode 100644 index 00000000000000..4a15506b7448d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-rut5_small_interpreter_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian rut5_small_interpreter_pipeline pipeline T5Transformer from Den4ikAI +author: John Snow Labs +name: rut5_small_interpreter_pipeline +date: 2024-08-21 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_small_interpreter_pipeline` is a Russian model originally trained by Den4ikAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_small_interpreter_pipeline_ru_5.4.2_3.0_1724220352774.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_small_interpreter_pipeline_ru_5.4.2_3.0_1724220352774.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_small_interpreter_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_small_interpreter_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_small_interpreter_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|277.3 MB| + +## References + +https://huggingface.co/Den4ikAI/ruT5-small-interpreter + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-rut5_small_interpreter_ru.md b/docs/_posts/ahmedlone127/2024-08-21-rut5_small_interpreter_ru.md new file mode 100644 index 00000000000000..750061f94e794a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-rut5_small_interpreter_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian rut5_small_interpreter T5Transformer from Den4ikAI +author: John Snow Labs +name: rut5_small_interpreter +date: 2024-08-21 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_small_interpreter` is a Russian model originally trained by Den4ikAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_small_interpreter_ru_5.4.2_3.0_1724220338140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_small_interpreter_ru_5.4.2_3.0_1724220338140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_small_interpreter","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_small_interpreter", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_small_interpreter| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|277.3 MB| + +## References + +https://huggingface.co/Den4ikAI/ruT5-small-interpreter \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-rut5summarizer_en.md b/docs/_posts/ahmedlone127/2024-08-21-rut5summarizer_en.md new file mode 100644 index 00000000000000..1bb8a0d91fd27b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-rut5summarizer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5summarizer T5Transformer from Shalazary +author: John Snow Labs +name: rut5summarizer +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5summarizer` is a English model originally trained by Shalazary. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5summarizer_en_5.4.2_3.0_1724252471992.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5summarizer_en_5.4.2_3.0_1724252471992.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5summarizer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5summarizer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5summarizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shalazary/ruT5summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-rut5summarizer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-rut5summarizer_pipeline_en.md new file mode 100644 index 00000000000000..aa3c70a7bcc220 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-rut5summarizer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5summarizer_pipeline pipeline T5Transformer from Shalazary +author: John Snow Labs +name: rut5summarizer_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5summarizer_pipeline` is a English model originally trained by Shalazary. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5summarizer_pipeline_en_5.4.2_3.0_1724252519777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5summarizer_pipeline_en_5.4.2_3.0_1724252519777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5summarizer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5summarizer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5summarizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shalazary/ruT5summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-scipaper_summary_en.md b/docs/_posts/ahmedlone127/2024-08-21-scipaper_summary_en.md new file mode 100644 index 00000000000000..fbf777c5816dbb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-scipaper_summary_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English scipaper_summary T5Transformer from shed-e +author: John Snow Labs +name: scipaper_summary +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scipaper_summary` is a English model originally trained by shed-e. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scipaper_summary_en_5.4.2_3.0_1724250493642.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scipaper_summary_en_5.4.2_3.0_1724250493642.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("scipaper_summary","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("scipaper_summary", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scipaper_summary| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.4 MB| + +## References + +https://huggingface.co/shed-e/scipaper-summary \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-scipaper_summary_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-scipaper_summary_pipeline_en.md new file mode 100644 index 00000000000000..38157ca9253826 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-scipaper_summary_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English scipaper_summary_pipeline pipeline T5Transformer from shed-e +author: John Snow Labs +name: scipaper_summary_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scipaper_summary_pipeline` is a English model originally trained by shed-e. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scipaper_summary_pipeline_en_5.4.2_3.0_1724250511591.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scipaper_summary_pipeline_en_5.4.2_3.0_1724250511591.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("scipaper_summary_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("scipaper_summary_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scipaper_summary_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.4 MB| + +## References + +https://huggingface.co/shed-e/scipaper-summary + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-simctgt5_small_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-21-simctgt5_small_xsum_en.md new file mode 100644 index 00000000000000..afd83aed4a4679 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-simctgt5_small_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English simctgt5_small_xsum T5Transformer from cambridgeltl +author: John Snow Labs +name: simctgt5_small_xsum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`simctgt5_small_xsum` is a English model originally trained by cambridgeltl. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/simctgt5_small_xsum_en_5.4.2_3.0_1724252008291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/simctgt5_small_xsum_en_5.4.2_3.0_1724252008291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("simctgt5_small_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("simctgt5_small_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|simctgt5_small_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|324.6 MB| + +## References + +https://huggingface.co/cambridgeltl/simctgt5_small_xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-simctgt5_small_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-simctgt5_small_xsum_pipeline_en.md new file mode 100644 index 00000000000000..3555cc3816323a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-simctgt5_small_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English simctgt5_small_xsum_pipeline pipeline T5Transformer from cambridgeltl +author: John Snow Labs +name: simctgt5_small_xsum_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`simctgt5_small_xsum_pipeline` is a English model originally trained by cambridgeltl. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/simctgt5_small_xsum_pipeline_en_5.4.2_3.0_1724252030778.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/simctgt5_small_xsum_pipeline_en_5.4.2_3.0_1724252030778.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("simctgt5_small_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("simctgt5_small_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|simctgt5_small_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|324.6 MB| + +## References + +https://huggingface.co/cambridgeltl/simctgt5_small_xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-speller_t5_ds_en.md b/docs/_posts/ahmedlone127/2024-08-21-speller_t5_ds_en.md new file mode 100644 index 00000000000000..76a85c977bd2f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-speller_t5_ds_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_ds T5Transformer from summervent +author: John Snow Labs +name: speller_t5_ds +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_ds` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_ds_en_5.4.2_3.0_1724252570925.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_ds_en_5.4.2_3.0_1724252570925.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_ds","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_ds", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_ds| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-ds \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-speller_t5_ds_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-speller_t5_ds_pipeline_en.md new file mode 100644 index 00000000000000..bd964344801d38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-speller_t5_ds_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_ds_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_ds_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_ds_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_ds_pipeline_en_5.4.2_3.0_1724252619169.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_ds_pipeline_en_5.4.2_3.0_1724252619169.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_ds_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_ds_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_ds_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-ds + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-sqt5_large_pipeline_sq.md b/docs/_posts/ahmedlone127/2024-08-21-sqt5_large_pipeline_sq.md new file mode 100644 index 00000000000000..fa169511550d8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-sqt5_large_pipeline_sq.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Albanian sqt5_large_pipeline pipeline T5Transformer from niv-al +author: John Snow Labs +name: sqt5_large_pipeline +date: 2024-08-21 +tags: [sq, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: sq +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sqt5_large_pipeline` is a Albanian model originally trained by niv-al. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sqt5_large_pipeline_sq_5.4.2_3.0_1724259861017.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sqt5_large_pipeline_sq_5.4.2_3.0_1724259861017.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sqt5_large_pipeline", lang = "sq") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sqt5_large_pipeline", lang = "sq") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sqt5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|sq| +|Size:|172.8 MB| + +## References + +https://huggingface.co/niv-al/sqt5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-sqt5_large_sq.md b/docs/_posts/ahmedlone127/2024-08-21-sqt5_large_sq.md new file mode 100644 index 00000000000000..8e2f1201c0e433 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-sqt5_large_sq.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Albanian sqt5_large T5Transformer from niv-al +author: John Snow Labs +name: sqt5_large +date: 2024-08-21 +tags: [sq, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: sq +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sqt5_large` is a Albanian model originally trained by niv-al. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sqt5_large_sq_5.4.2_3.0_1724259799915.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sqt5_large_sq_5.4.2_3.0_1724259799915.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sqt5_large","sq") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sqt5_large", "sq") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sqt5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|sq| +|Size:|172.8 MB| + +## References + +https://huggingface.co/niv-al/sqt5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-srbd_execution_flan_t5_base_kowshic_en.md b/docs/_posts/ahmedlone127/2024-08-21-srbd_execution_flan_t5_base_kowshic_en.md new file mode 100644 index 00000000000000..b23d34a91f2bea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-srbd_execution_flan_t5_base_kowshic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English srbd_execution_flan_t5_base_kowshic T5Transformer from kowshic +author: John Snow Labs +name: srbd_execution_flan_t5_base_kowshic +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`srbd_execution_flan_t5_base_kowshic` is a English model originally trained by kowshic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/srbd_execution_flan_t5_base_kowshic_en_5.4.2_3.0_1724216140198.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/srbd_execution_flan_t5_base_kowshic_en_5.4.2_3.0_1724216140198.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("srbd_execution_flan_t5_base_kowshic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("srbd_execution_flan_t5_base_kowshic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|srbd_execution_flan_t5_base_kowshic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kowshic/srbd-execution-flan-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-srbd_execution_flan_t5_base_kowshic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-srbd_execution_flan_t5_base_kowshic_pipeline_en.md new file mode 100644 index 00000000000000..00040c6a74fb25 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-srbd_execution_flan_t5_base_kowshic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English srbd_execution_flan_t5_base_kowshic_pipeline pipeline T5Transformer from kowshic +author: John Snow Labs +name: srbd_execution_flan_t5_base_kowshic_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`srbd_execution_flan_t5_base_kowshic_pipeline` is a English model originally trained by kowshic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/srbd_execution_flan_t5_base_kowshic_pipeline_en_5.4.2_3.0_1724216192729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/srbd_execution_flan_t5_base_kowshic_pipeline_en_5.4.2_3.0_1724216192729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("srbd_execution_flan_t5_base_kowshic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("srbd_execution_flan_t5_base_kowshic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|srbd_execution_flan_t5_base_kowshic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kowshic/srbd-execution-flan-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-sum_model_maniack_en.md b/docs/_posts/ahmedlone127/2024-08-21-sum_model_maniack_en.md new file mode 100644 index 00000000000000..94dac834c081e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-sum_model_maniack_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sum_model_maniack T5Transformer from maniack +author: John Snow Labs +name: sum_model_maniack +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_maniack` is a English model originally trained by maniack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_maniack_en_5.4.2_3.0_1724283961599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_maniack_en_5.4.2_3.0_1724283961599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sum_model_maniack","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sum_model_maniack", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_maniack| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/maniack/sum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-sum_model_maniack_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-sum_model_maniack_pipeline_en.md new file mode 100644 index 00000000000000..c193445c4c64a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-sum_model_maniack_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sum_model_maniack_pipeline pipeline T5Transformer from maniack +author: John Snow Labs +name: sum_model_maniack_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_maniack_pipeline` is a English model originally trained by maniack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_maniack_pipeline_en_5.4.2_3.0_1724283983948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_maniack_pipeline_en_5.4.2_3.0_1724283983948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sum_model_maniack_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sum_model_maniack_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_maniack_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/maniack/sum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-summarization_sif10_en.md b/docs/_posts/ahmedlone127/2024-08-21-summarization_sif10_en.md new file mode 100644 index 00000000000000..e4bed181c532ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-summarization_sif10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarization_sif10 T5Transformer from Sif10 +author: John Snow Labs +name: summarization_sif10 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_sif10` is a English model originally trained by Sif10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_sif10_en_5.4.2_3.0_1724264275341.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_sif10_en_5.4.2_3.0_1724264275341.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarization_sif10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarization_sif10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_sif10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|998.7 MB| + +## References + +https://huggingface.co/Sif10/summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-summarization_sif10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-summarization_sif10_pipeline_en.md new file mode 100644 index 00000000000000..780f0682c88723 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-summarization_sif10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarization_sif10_pipeline pipeline T5Transformer from Sif10 +author: John Snow Labs +name: summarization_sif10_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_sif10_pipeline` is a English model originally trained by Sif10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_sif10_pipeline_en_5.4.2_3.0_1724264324318.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_sif10_pipeline_en_5.4.2_3.0_1724264324318.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarization_sif10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarization_sif10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_sif10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|998.7 MB| + +## References + +https://huggingface.co/Sif10/summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-summarizer_google_long_t5_tglobal_base_mesh_faceted_en.md b/docs/_posts/ahmedlone127/2024-08-21-summarizer_google_long_t5_tglobal_base_mesh_faceted_en.md new file mode 100644 index 00000000000000..fe9d935b661385 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-summarizer_google_long_t5_tglobal_base_mesh_faceted_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_mesh_faceted T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_mesh_faceted +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_mesh_faceted` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_mesh_faceted_en_5.4.2_3.0_1724283532667.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_mesh_faceted_en_5.4.2_3.0_1724283532667.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_mesh_faceted","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_mesh_faceted", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_mesh_faceted| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_mesh_faceted \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline_en.md new file mode 100644 index 00000000000000..157d1426fcc215 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline_en_5.4.2_3.0_1724283580858.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline_en_5.4.2_3.0_1724283580858.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_mesh_faceted_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_mesh_faceted + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-summary_dialogue_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-21-summary_dialogue_pipeline_zh.md new file mode 100644 index 00000000000000..41701fd63ff437 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-summary_dialogue_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese summary_dialogue_pipeline pipeline T5Transformer from svjack +author: John Snow Labs +name: summary_dialogue_pipeline +date: 2024-08-21 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summary_dialogue_pipeline` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summary_dialogue_pipeline_zh_5.4.2_3.0_1724270016977.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summary_dialogue_pipeline_zh_5.4.2_3.0_1724270016977.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summary_dialogue_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summary_dialogue_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summary_dialogue_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|983.1 MB| + +## References + +https://huggingface.co/svjack/summary-dialogue + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-summary_dialogue_zh.md b/docs/_posts/ahmedlone127/2024-08-21-summary_dialogue_zh.md new file mode 100644 index 00000000000000..d3b1bd1984d838 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-summary_dialogue_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese summary_dialogue T5Transformer from svjack +author: John Snow Labs +name: summary_dialogue +date: 2024-08-21 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summary_dialogue` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summary_dialogue_zh_5.4.2_3.0_1724269968979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summary_dialogue_zh_5.4.2_3.0_1724269968979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summary_dialogue","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summary_dialogue", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summary_dialogue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|983.1 MB| + +## References + +https://huggingface.co/svjack/summary-dialogue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_1_1_lm100k_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_1_1_lm100k_base_en.md new file mode 100644 index 00000000000000..6debd5f9a8e606 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_1_1_lm100k_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_1_1_lm100k_base T5Transformer from tscholak +author: John Snow Labs +name: t5_1_1_lm100k_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1_1_lm100k_base` is a English model originally trained by tscholak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_base_en_5.4.2_3.0_1724212879208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_base_en_5.4.2_3.0_1724212879208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_1_1_lm100k_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_1_1_lm100k_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1_1_lm100k_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.7 MB| + +## References + +https://huggingface.co/tscholak/t5.1.1.lm100k.base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_1_1_lm100k_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_1_1_lm100k_base_pipeline_en.md new file mode 100644 index 00000000000000..dbe4daccd06181 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_1_1_lm100k_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_1_1_lm100k_base_pipeline pipeline T5Transformer from tscholak +author: John Snow Labs +name: t5_1_1_lm100k_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1_1_lm100k_base_pipeline` is a English model originally trained by tscholak. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_base_pipeline_en_5.4.2_3.0_1724213059248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_base_pipeline_en_5.4.2_3.0_1724213059248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_1_1_lm100k_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_1_1_lm100k_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1_1_lm100k_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.7 MB| + +## References + +https://huggingface.co/tscholak/t5.1.1.lm100k.base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_1e_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_1e_en.md new file mode 100644 index 00000000000000..39c6c1c7bd467c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_1e_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_1e T5Transformer from Shana4 +author: John Snow Labs +name: t5_1e +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1e` is a English model originally trained by Shana4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1e_en_5.4.2_3.0_1724242279275.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1e_en_5.4.2_3.0_1724242279275.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_1e","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_1e", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1e| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shana4/T5_1E \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_1e_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_1e_pipeline_en.md new file mode 100644 index 00000000000000..80dd13048c9666 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_1e_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_1e_pipeline pipeline T5Transformer from Shana4 +author: John Snow Labs +name: t5_1e_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1e_pipeline` is a English model originally trained by Shana4. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1e_pipeline_en_5.4.2_3.0_1724242333361.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1e_pipeline_en_5.4.2_3.0_1724242333361.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_1e_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_1e_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1e_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Shana4/T5_1E + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_23_emotions_detections_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_23_emotions_detections_en.md new file mode 100644 index 00000000000000..6ccfcc7df91b1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_23_emotions_detections_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_23_emotions_detections T5Transformer from addy88 +author: John Snow Labs +name: t5_23_emotions_detections +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_23_emotions_detections` is a English model originally trained by addy88. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_23_emotions_detections_en_5.4.2_3.0_1724253425510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_23_emotions_detections_en_5.4.2_3.0_1724253425510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_23_emotions_detections","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_23_emotions_detections", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_23_emotions_detections| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|974.4 MB| + +## References + +https://huggingface.co/addy88/T5-23-emotions-detections \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_23_emotions_detections_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_23_emotions_detections_pipeline_en.md new file mode 100644 index 00000000000000..8bc2981a0b137a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_23_emotions_detections_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_23_emotions_detections_pipeline pipeline T5Transformer from addy88 +author: John Snow Labs +name: t5_23_emotions_detections_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_23_emotions_detections_pipeline` is a English model originally trained by addy88. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_23_emotions_detections_pipeline_en_5.4.2_3.0_1724253484157.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_23_emotions_detections_pipeline_en_5.4.2_3.0_1724253484157.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_23_emotions_detections_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_23_emotions_detections_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_23_emotions_detections_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|974.4 MB| + +## References + +https://huggingface.co/addy88/T5-23-emotions-detections + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_4248_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_4248_en.md new file mode 100644 index 00000000000000..5b43a83f5306c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_4248_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_4248 T5Transformer from tzytzytzy +author: John Snow Labs +name: t5_4248 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_4248` is a English model originally trained by tzytzytzy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_4248_en_5.4.2_3.0_1724238548019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_4248_en_5.4.2_3.0_1724238548019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_4248","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_4248", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_4248| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/tzytzytzy/t5_4248 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_4248_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_4248_pipeline_en.md new file mode 100644 index 00000000000000..7f3f47b82a946b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_4248_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_4248_pipeline pipeline T5Transformer from tzytzytzy +author: John Snow Labs +name: t5_4248_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_4248_pipeline` is a English model originally trained by tzytzytzy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_4248_pipeline_en_5.4.2_3.0_1724238725432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_4248_pipeline_en_5.4.2_3.0_1724238725432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_4248_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_4248_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_4248_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/tzytzytzy/t5_4248 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2012_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2012_en.md new file mode 100644 index 00000000000000..31aa2a72b62670 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2012_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_en_5.4.2_3.0_1724244653567.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_en_5.4.2_3.0_1724244653567.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2012_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2012_pipeline_en.md new file mode 100644 index 00000000000000..89c742f68b0184 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2012_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_pipeline_en_5.4.2_3.0_1724244670943.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_pipeline_en_5.4.2_3.0_1724244670943.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2012_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2012_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2014_8_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2014_8_en.md new file mode 100644 index 00000000000000..63db8e07bddbc9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2014_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_8 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_8_en_5.4.2_3.0_1724259184076.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_8_en_5.4.2_3.0_1724259184076.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2014_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2014_8_pipeline_en.md new file mode 100644 index 00000000000000..755e58c354e9ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2014_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_8_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_8_pipeline_en_5.4.2_3.0_1724259201024.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_8_pipeline_en_5.4.2_3.0_1724259201024.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2014_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2014_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2015_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2015_en.md new file mode 100644 index 00000000000000..a5b9e93af5e8d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2015_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_en_5.4.2_3.0_1724259963453.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_en_5.4.2_3.0_1724259963453.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2015_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2015_pipeline_en.md new file mode 100644 index 00000000000000..aafe6720bc185c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2015_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_pipeline_en_5.4.2_3.0_1724259980433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_pipeline_en_5.4.2_3.0_1724259980433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2015_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2015_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_7_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_7_en.md new file mode 100644 index 00000000000000..bc7201c0d4b074 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_7 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_7 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_7` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_7_en_5.4.2_3.0_1724252003363.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_7_en_5.4.2_3.0_1724252003363.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_7_pipeline_en.md new file mode 100644 index 00000000000000..b089ad6c76ecd5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_7_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_7_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_7_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_7_pipeline_en_5.4.2_3.0_1724252020525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_7_pipeline_en_5.4.2_3.0_1724252020525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2016_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2016_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_8_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_8_en.md new file mode 100644 index 00000000000000..272a131b66d41b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_8 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_8_en_5.4.2_3.0_1724277779023.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_8_en_5.4.2_3.0_1724277779023.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_8_pipeline_en.md new file mode 100644 index 00000000000000..8d36c8afe4e078 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2016_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_8_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_8_pipeline_en_5.4.2_3.0_1724277796283.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_8_pipeline_en_5.4.2_3.0_1724277796283.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2016_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2016_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2019_9_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2019_9_en.md new file mode 100644 index 00000000000000..f002f2eaa72aad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2019_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_9 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_9 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_9` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_9_en_5.4.2_3.0_1724200676720.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_9_en_5.4.2_3.0_1724200676720.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2019_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2019_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2019_9_pipeline_en.md new file mode 100644 index 00000000000000..8892f65d9deb33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2019_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2019_9_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2019_9_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2019_9_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_9_pipeline_en_5.4.2_3.0_1724200693992.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2019_9_pipeline_en_5.4.2_3.0_1724200693992.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2019_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2019_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2019_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2019-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2021_1_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2021_1_en.md new file mode 100644 index 00000000000000..b2daa6c72b60c7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2021_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_1_en_5.4.2_3.0_1724254224283.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_1_en_5.4.2_3.0_1724254224283.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2021_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2021_1_pipeline_en.md new file mode 100644 index 00000000000000..8e821d6d029f4e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_lm_wmt_2021_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_1_pipeline_en_5.4.2_3.0_1724254241192.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_1_pipeline_en_5.4.2_3.0_1724254241192.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2021_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2021_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2016_7_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2016_7_en.md new file mode 100644 index 00000000000000..cf6d8e8c8dcb3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2016_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_7 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_7 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_7` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_7_en_5.4.2_3.0_1724275212751.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_7_en_5.4.2_3.0_1724275212751.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2016_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2016_7_pipeline_en.md new file mode 100644 index 00000000000000..29b3213b8c7628 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2016_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_7_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_7_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_7_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_7_pipeline_en_5.4.2_3.0_1724275241353.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_7_pipeline_en_5.4.2_3.0_1724275241353.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2016_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2016_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2017_8_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2017_8_en.md new file mode 100644 index 00000000000000..a19e9fdb08cf17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2017_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_8 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_8 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_8` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_8_en_5.4.2_3.0_1724237764743.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_8_en_5.4.2_3.0_1724237764743.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|299.4 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2017_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2017_8_pipeline_en.md new file mode 100644 index 00000000000000..96e5268a4441fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_60m_poli_aff_2017_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_8_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_8_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_8_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_8_pipeline_en_5.4.2_3.0_1724237794421.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_8_pipeline_en_5.4.2_3.0_1724237794421.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2017_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2017_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|299.4 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_adv_mtop_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_adv_mtop_en.md new file mode 100644 index 00000000000000..81953fbe0fe73b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_adv_mtop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_adv_mtop T5Transformer from WillHeld +author: John Snow Labs +name: t5_base_adv_mtop +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_adv_mtop` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_adv_mtop_en_5.4.2_3.0_1724275821170.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_adv_mtop_en_5.4.2_3.0_1724275821170.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_adv_mtop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_adv_mtop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_adv_mtop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/WillHeld/t5-base-adv-mtop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_adv_mtop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_adv_mtop_pipeline_en.md new file mode 100644 index 00000000000000..ce3fe9f1b1fbd8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_adv_mtop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_adv_mtop_pipeline pipeline T5Transformer from WillHeld +author: John Snow Labs +name: t5_base_adv_mtop_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_adv_mtop_pipeline` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_adv_mtop_pipeline_en_5.4.2_3.0_1724276117574.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_adv_mtop_pipeline_en_5.4.2_3.0_1724276117574.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_adv_mtop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_adv_mtop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_adv_mtop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/WillHeld/t5-base-adv-mtop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_alpaca_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_alpaca_en.md new file mode 100644 index 00000000000000..f3f3fa6ecc8d3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_alpaca_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_alpaca T5Transformer from reasonwang +author: John Snow Labs +name: t5_base_alpaca +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_alpaca` is a English model originally trained by reasonwang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_alpaca_en_5.4.2_3.0_1724272462265.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_alpaca_en_5.4.2_3.0_1724272462265.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_alpaca","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_alpaca", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_alpaca| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/reasonwang/t5-base-alpaca \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_alpaca_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_alpaca_pipeline_en.md new file mode 100644 index 00000000000000..0ec6c0d78b19b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_alpaca_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_alpaca_pipeline pipeline T5Transformer from reasonwang +author: John Snow Labs +name: t5_base_alpaca_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_alpaca_pipeline` is a English model originally trained by reasonwang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_alpaca_pipeline_en_5.4.2_3.0_1724272510533.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_alpaca_pipeline_en_5.4.2_3.0_1724272510533.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_alpaca_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_alpaca_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_alpaca_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/reasonwang/t5-base-alpaca + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_asqa_ob_din0s_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_asqa_ob_din0s_en.md new file mode 100644 index 00000000000000..881155ec48cc68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_asqa_ob_din0s_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_asqa_ob_din0s T5Transformer from din0s +author: John Snow Labs +name: t5_base_asqa_ob_din0s +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_asqa_ob_din0s` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_asqa_ob_din0s_en_5.4.2_3.0_1724283783976.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_asqa_ob_din0s_en_5.4.2_3.0_1724283783976.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_asqa_ob_din0s","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_asqa_ob_din0s", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_asqa_ob_din0s| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.9 MB| + +## References + +https://huggingface.co/din0s/t5-base-asqa-ob \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_asqa_ob_din0s_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_asqa_ob_din0s_pipeline_en.md new file mode 100644 index 00000000000000..aedbb5b6bf5683 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_asqa_ob_din0s_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_asqa_ob_din0s_pipeline pipeline T5Transformer from din0s +author: John Snow Labs +name: t5_base_asqa_ob_din0s_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_asqa_ob_din0s_pipeline` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_asqa_ob_din0s_pipeline_en_5.4.2_3.0_1724283833078.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_asqa_ob_din0s_pipeline_en_5.4.2_3.0_1724283833078.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_asqa_ob_din0s_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_asqa_ob_din0s_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_asqa_ob_din0s_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.9 MB| + +## References + +https://huggingface.co/din0s/t5-base-asqa-ob + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_break_high_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_break_high_en.md new file mode 100644 index 00000000000000..8cea76ddf2e58d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_break_high_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_break_high T5Transformer from msterbentz +author: John Snow Labs +name: t5_base_break_high +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_break_high` is a English model originally trained by msterbentz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_break_high_en_5.4.2_3.0_1724201316068.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_break_high_en_5.4.2_3.0_1724201316068.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_break_high","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_break_high", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_break_high| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.3 MB| + +## References + +https://huggingface.co/msterbentz/t5-base-break-high \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_break_high_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_break_high_pipeline_en.md new file mode 100644 index 00000000000000..add19e1d42f96e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_break_high_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_break_high_pipeline pipeline T5Transformer from msterbentz +author: John Snow Labs +name: t5_base_break_high_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_break_high_pipeline` is a English model originally trained by msterbentz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_break_high_pipeline_en_5.4.2_3.0_1724201370850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_break_high_pipeline_en_5.4.2_3.0_1724201370850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_break_high_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_break_high_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_break_high_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.3 MB| + +## References + +https://huggingface.co/msterbentz/t5-base-break-high + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_cnndaily_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_cnndaily_en.md new file mode 100644 index 00000000000000..9e8aada707c07a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_cnndaily_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_cnndaily T5Transformer from navjordj +author: John Snow Labs +name: t5_base_cnndaily +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cnndaily` is a English model originally trained by navjordj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cnndaily_en_5.4.2_3.0_1724251381107.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cnndaily_en_5.4.2_3.0_1724251381107.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_cnndaily","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_cnndaily", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cnndaily| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/navjordj/t5-base-cnndaily \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_cnndaily_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_cnndaily_pipeline_en.md new file mode 100644 index 00000000000000..2143358d494c1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_cnndaily_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_cnndaily_pipeline pipeline T5Transformer from navjordj +author: John Snow Labs +name: t5_base_cnndaily_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_cnndaily_pipeline` is a English model originally trained by navjordj. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_cnndaily_pipeline_en_5.4.2_3.0_1724251556892.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_cnndaily_pipeline_en_5.4.2_3.0_1724251556892.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_cnndaily_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_cnndaily_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_cnndaily_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/navjordj/t5-base-cnndaily + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_dialogsum_seed55_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_dialogsum_seed55_en.md new file mode 100644 index 00000000000000..d4d9afb397b91e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_dialogsum_seed55_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_dialogsum_seed55 T5Transformer from PSW +author: John Snow Labs +name: t5_base_dialogsum_seed55 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dialogsum_seed55` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dialogsum_seed55_en_5.4.2_3.0_1724200373188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dialogsum_seed55_en_5.4.2_3.0_1724200373188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_dialogsum_seed55","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_dialogsum_seed55", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dialogsum_seed55| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-dialogsum-seed55 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_dialogsum_seed55_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_dialogsum_seed55_pipeline_en.md new file mode 100644 index 00000000000000..1778d73baf4a54 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_dialogsum_seed55_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_dialogsum_seed55_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_dialogsum_seed55_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dialogsum_seed55_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dialogsum_seed55_pipeline_en_5.4.2_3.0_1724200422316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dialogsum_seed55_pipeline_en_5.4.2_3.0_1724200422316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_dialogsum_seed55_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_dialogsum_seed55_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dialogsum_seed55_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-dialogsum-seed55 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_dreambank_generation_emot_char_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_dreambank_generation_emot_char_en.md new file mode 100644 index 00000000000000..9946e9efbcd433 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_dreambank_generation_emot_char_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_dreambank_generation_emot_char T5Transformer from DReAMy-lib +author: John Snow Labs +name: t5_base_dreambank_generation_emot_char +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dreambank_generation_emot_char` is a English model originally trained by DReAMy-lib. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dreambank_generation_emot_char_en_5.4.2_3.0_1724271189554.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dreambank_generation_emot_char_en_5.4.2_3.0_1724271189554.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_dreambank_generation_emot_char","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_dreambank_generation_emot_char", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dreambank_generation_emot_char| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/DReAMy-lib/t5-base-DreamBank-Generation-Emot-Char \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_dreambank_generation_emot_char_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_dreambank_generation_emot_char_pipeline_en.md new file mode 100644 index 00000000000000..35eec492b6dd47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_dreambank_generation_emot_char_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_dreambank_generation_emot_char_pipeline pipeline T5Transformer from DReAMy-lib +author: John Snow Labs +name: t5_base_dreambank_generation_emot_char_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dreambank_generation_emot_char_pipeline` is a English model originally trained by DReAMy-lib. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dreambank_generation_emot_char_pipeline_en_5.4.2_3.0_1724271238240.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dreambank_generation_emot_char_pipeline_en_5.4.2_3.0_1724271238240.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_dreambank_generation_emot_char_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_dreambank_generation_emot_char_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dreambank_generation_emot_char_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/DReAMy-lib/t5-base-DreamBank-Generation-Emot-Char + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_e2e_question_generation_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_e2e_question_generation_en.md new file mode 100644 index 00000000000000..48f1deb93daea7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_e2e_question_generation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_e2e_question_generation T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_e2e_question_generation +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_e2e_question_generation` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_e2e_question_generation_en_5.4.2_3.0_1724216765534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_e2e_question_generation_en_5.4.2_3.0_1724216765534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_e2e_question_generation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_e2e_question_generation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_e2e_question_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mrm8488/t5-base-e2e-question-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_e2e_question_generation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_e2e_question_generation_pipeline_en.md new file mode 100644 index 00000000000000..359e8972110707 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_e2e_question_generation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_e2e_question_generation_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_e2e_question_generation_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_e2e_question_generation_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_e2e_question_generation_pipeline_en_5.4.2_3.0_1724216816580.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_e2e_question_generation_pipeline_en_5.4.2_3.0_1724216816580.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_e2e_question_generation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_e2e_question_generation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_e2e_question_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mrm8488/t5-base-e2e-question-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_extraction_cnndm_10000_all_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_extraction_cnndm_10000_all_en.md new file mode 100644 index 00000000000000..6750fdbeee2c49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_extraction_cnndm_10000_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_extraction_cnndm_10000_all T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_extraction_cnndm_10000_all +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_extraction_cnndm_10000_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_10000_all_en_5.4.2_3.0_1724281058544.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_10000_all_en_5.4.2_3.0_1724281058544.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_extraction_cnndm_10000_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_extraction_cnndm_10000_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_extraction_cnndm_10000_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|990.6 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-extraction-cnndm_10000-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_extraction_cnndm_10000_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_extraction_cnndm_10000_all_pipeline_en.md new file mode 100644 index 00000000000000..d9fcb1405e75e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_extraction_cnndm_10000_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_extraction_cnndm_10000_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_extraction_cnndm_10000_all_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_extraction_cnndm_10000_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_10000_all_pipeline_en_5.4.2_3.0_1724281108956.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_extraction_cnndm_10000_all_pipeline_en_5.4.2_3.0_1724281108956.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_extraction_cnndm_10000_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_extraction_cnndm_10000_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_extraction_cnndm_10000_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|990.6 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-extraction-cnndm_10000-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_en.md new file mode 100644 index 00000000000000..f13f6f97887561 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724275875165.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724275875165.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|974.3 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-1024-finetuned-squad-infilling-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..8a99d28df45bbd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724275933670.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724275933670.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_1024_finetuned_squad_infilling_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|974.3 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-1024-finetuned-squad-infilling-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_16_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_16_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..bf3e351342118a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_16_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_16_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_16_finetuned_squad_seed_2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_16_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_seed_2_en_5.4.2_3.0_1724276967515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_seed_2_en_5.4.2_3.0_1724276967515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_16_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_16_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_16_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|931.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-16-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..711d574767dc2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724277038773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724277038773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_16_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|931.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-16-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_en.md new file mode 100644 index 00000000000000..73927b0f0cc4fd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_common_gen T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_common_gen +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_common_gen` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_common_gen_en_5.4.2_3.0_1724213480248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_common_gen_en_5.4.2_3.0_1724213480248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_common_gen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_common_gen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_common_gen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|940.6 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-common_gen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_en.md new file mode 100644 index 00000000000000..976333e6794515 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence T5Transformer from Ziyi98 +author: John Snow Labs +name: t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence` is a English model originally trained by Ziyi98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_en_5.4.2_3.0_1724216559392.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_en_5.4.2_3.0_1724216559392.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ziyi98/t5-base-finetuned-common_gen-finetuned-keywords-to-sentence \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline_en.md new file mode 100644 index 00000000000000..c7f1fbe8445afb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline pipeline T5Transformer from Ziyi98 +author: John Snow Labs +name: t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline` is a English model originally trained by Ziyi98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline_en_5.4.2_3.0_1724216621126.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline_en_5.4.2_3.0_1724216621126.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_common_gen_finetuned_keywords_tonga_tonga_islands_sentence_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ziyi98/t5-base-finetuned-common_gen-finetuned-keywords-to-sentence + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_pipeline_en.md new file mode 100644 index 00000000000000..21fc606777b4a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_common_gen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_common_gen_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_common_gen_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_common_gen_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_common_gen_pipeline_en_5.4.2_3.0_1724213547915.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_common_gen_pipeline_en_5.4.2_3.0_1724213547915.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_common_gen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_common_gen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_common_gen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|940.6 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-common_gen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_english_tonga_tonga_islands_italian_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_english_tonga_tonga_islands_italian_en.md new file mode 100644 index 00000000000000..9e4f4aa3cd30a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_english_tonga_tonga_islands_italian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_italian T5Transformer from din0s +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_italian +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_italian` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_italian_en_5.4.2_3.0_1724202857876.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_italian_en_5.4.2_3.0_1724202857876.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_italian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_english_tonga_tonga_islands_italian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_italian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/din0s/t5-base-finetuned-en-to-it \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline_en.md new file mode 100644 index 00000000000000..8962eea7c8969e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline pipeline T5Transformer from din0s +author: John Snow Labs +name: t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline_en_5.4.2_3.0_1724202909340.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline_en_5.4.2_3.0_1724202909340.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_english_tonga_tonga_islands_italian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/din0s/t5-base-finetuned-en-to-it + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_eyeofriyadh_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_eyeofriyadh_en.md new file mode 100644 index 00000000000000..9e0cf5d6d55353 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_eyeofriyadh_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_eyeofriyadh T5Transformer from eaalghamdi +author: John Snow Labs +name: t5_base_finetuned_eyeofriyadh +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_eyeofriyadh` is a English model originally trained by eaalghamdi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_eyeofriyadh_en_5.4.2_3.0_1724264502933.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_eyeofriyadh_en_5.4.2_3.0_1724264502933.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_eyeofriyadh","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_eyeofriyadh", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_eyeofriyadh| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|322.6 MB| + +## References + +https://huggingface.co/eaalghamdi/t5-base-finetuned-eyeofriyadh \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_eyeofriyadh_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_eyeofriyadh_pipeline_en.md new file mode 100644 index 00000000000000..6112340fbb4149 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_eyeofriyadh_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_eyeofriyadh_pipeline pipeline T5Transformer from eaalghamdi +author: John Snow Labs +name: t5_base_finetuned_eyeofriyadh_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_eyeofriyadh_pipeline` is a English model originally trained by eaalghamdi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_eyeofriyadh_pipeline_en_5.4.2_3.0_1724264525678.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_eyeofriyadh_pipeline_en_5.4.2_3.0_1724264525678.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_eyeofriyadh_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_eyeofriyadh_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_eyeofriyadh_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|322.6 MB| + +## References + +https://huggingface.co/eaalghamdi/t5-base-finetuned-eyeofriyadh + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_1d_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_1d_en.md new file mode 100644 index 00000000000000..805eb2765671a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_1d_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_math_linear_algebra_1d T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_math_linear_algebra_1d +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_math_linear_algebra_1d` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_math_linear_algebra_1d_en_5.4.2_3.0_1724227234973.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_math_linear_algebra_1d_en_5.4.2_3.0_1724227234973.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_math_linear_algebra_1d","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_math_linear_algebra_1d", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_math_linear_algebra_1d| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|887.8 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-math-linear-algebra-1d \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_1d_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_1d_pipeline_en.md new file mode 100644 index 00000000000000..2a645c67deab46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_1d_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_math_linear_algebra_1d_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_math_linear_algebra_1d_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_math_linear_algebra_1d_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_math_linear_algebra_1d_pipeline_en_5.4.2_3.0_1724227322526.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_math_linear_algebra_1d_pipeline_en_5.4.2_3.0_1724227322526.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_math_linear_algebra_1d_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_math_linear_algebra_1d_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_math_linear_algebra_1d_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|887.8 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-math-linear-algebra-1d + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_2d_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_2d_en.md new file mode 100644 index 00000000000000..75a4bd318feda5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_2d_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_math_linear_algebra_2d T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_math_linear_algebra_2d +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_math_linear_algebra_2d` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_math_linear_algebra_2d_en_5.4.2_3.0_1724281952413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_math_linear_algebra_2d_en_5.4.2_3.0_1724281952413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_math_linear_algebra_2d","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_math_linear_algebra_2d", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_math_linear_algebra_2d| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|887.7 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-math-linear-algebra-2d \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_2d_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_2d_pipeline_en.md new file mode 100644 index 00000000000000..bfd4e3f9450dea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_math_linear_algebra_2d_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_math_linear_algebra_2d_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_math_linear_algebra_2d_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_math_linear_algebra_2d_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_math_linear_algebra_2d_pipeline_en_5.4.2_3.0_1724282033293.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_math_linear_algebra_2d_pipeline_en_5.4.2_3.0_1724282033293.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_math_linear_algebra_2d_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_math_linear_algebra_2d_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_math_linear_algebra_2d_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|887.7 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-math-linear-algebra-2d + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_qqp_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_qqp_en.md new file mode 100644 index 00000000000000..834410c2199d2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_qqp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_qqp T5Transformer from PavanNeerudu +author: John Snow Labs +name: t5_base_finetuned_qqp +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_qqp` is a English model originally trained by PavanNeerudu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_qqp_en_5.4.2_3.0_1724283521780.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_qqp_en_5.4.2_3.0_1724283521780.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_qqp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_qqp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_qqp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PavanNeerudu/t5-base-finetuned-qqp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_qqp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_qqp_pipeline_en.md new file mode 100644 index 00000000000000..a4d1cba456c25a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_qqp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_qqp_pipeline pipeline T5Transformer from PavanNeerudu +author: John Snow Labs +name: t5_base_finetuned_qqp_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_qqp_pipeline` is a English model originally trained by PavanNeerudu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_qqp_pipeline_en_5.4.2_3.0_1724283571928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_qqp_pipeline_en_5.4.2_3.0_1724283571928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_qqp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_qqp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_qqp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PavanNeerudu/t5-base-finetuned-qqp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_spanish_tonga_tonga_islands_kog_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_spanish_tonga_tonga_islands_kog_en.md new file mode 100644 index 00000000000000..f067531d7766f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_spanish_tonga_tonga_islands_kog_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_spanish_tonga_tonga_islands_kog T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_spanish_tonga_tonga_islands_kog +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_spanish_tonga_tonga_islands_kog` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_kog_en_5.4.2_3.0_1724247166644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_kog_en_5.4.2_3.0_1724247166644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_spanish_tonga_tonga_islands_kog","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_spanish_tonga_tonga_islands_kog", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_spanish_tonga_tonga_islands_kog| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|953.5 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-es-to-kog \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline_en.md new file mode 100644 index 00000000000000..37737ca63f7a73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline pipeline T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline_en_5.4.2_3.0_1724247218718.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline_en_5.4.2_3.0_1724247218718.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_spanish_tonga_tonga_islands_kog_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|953.5 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-es-to-kog + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_en.md new file mode 100644 index 00000000000000..2fb467d3358971 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_en_5.4.2_3.0_1724246199091.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_en_5.4.2_3.0_1724246199091.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|937.4 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-unam-es-to-pua \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline_en.md new file mode 100644 index 00000000000000..3313e0e549d417 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline pipeline T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline_en_5.4.2_3.0_1724246255024.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline_en_5.4.2_3.0_1724246255024.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_unam_spanish_tonga_tonga_islands_pua_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|937.4 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-unam-es-to-pua + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_en.md new file mode 100644 index 00000000000000..735e1f99637701 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1 T5Transformer from anusha +author: John Snow Labs +name: t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1` is a English model originally trained by anusha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_en_5.4.2_3.0_1724262638899.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_en_5.4.2_3.0_1724262638899.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|961.7 MB| + +## References + +https://huggingface.co/anusha/t5-base-finetuned-wikiSQL-sql-to-en_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline_en.md new file mode 100644 index 00000000000000..44b76abfa9ae09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline pipeline T5Transformer from anusha +author: John Snow Labs +name: t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline` is a English model originally trained by anusha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline_en_5.4.2_3.0_1724262703868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline_en_5.4.2_3.0_1724262703868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_wikisql_sql_tonga_tonga_islands_english_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|961.7 MB| + +## References + +https://huggingface.co/anusha/t5-base-finetuned-wikiSQL-sql-to-en_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_xsum_abhishek9998_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_xsum_abhishek9998_en.md new file mode 100644 index 00000000000000..bbd0119f958bf7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_xsum_abhishek9998_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_xsum_abhishek9998 T5Transformer from Abhishek9998 +author: John Snow Labs +name: t5_base_finetuned_xsum_abhishek9998 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_xsum_abhishek9998` is a English model originally trained by Abhishek9998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_abhishek9998_en_5.4.2_3.0_1724231552936.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_abhishek9998_en_5.4.2_3.0_1724231552936.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_xsum_abhishek9998","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_xsum_abhishek9998", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_xsum_abhishek9998| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|987.4 MB| + +## References + +https://huggingface.co/Abhishek9998/t5-base-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_xsum_abhishek9998_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_xsum_abhishek9998_pipeline_en.md new file mode 100644 index 00000000000000..da5cd0dfd894f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_finetuned_xsum_abhishek9998_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_xsum_abhishek9998_pipeline pipeline T5Transformer from Abhishek9998 +author: John Snow Labs +name: t5_base_finetuned_xsum_abhishek9998_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_xsum_abhishek9998_pipeline` is a English model originally trained by Abhishek9998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_abhishek9998_pipeline_en_5.4.2_3.0_1724231604500.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_abhishek9998_pipeline_en_5.4.2_3.0_1724231604500.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_xsum_abhishek9998_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_xsum_abhishek9998_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_xsum_abhishek9998_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|987.4 MB| + +## References + +https://huggingface.co/Abhishek9998/t5-base-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_keyphrase_gen_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_keyphrase_gen_en.md new file mode 100644 index 00000000000000..caf3fb3959ea83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_keyphrase_gen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_keyphrase_gen T5Transformer from sunitha98 +author: John Snow Labs +name: t5_base_keyphrase_gen +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_keyphrase_gen` is a English model originally trained by sunitha98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_keyphrase_gen_en_5.4.2_3.0_1724264640776.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_keyphrase_gen_en_5.4.2_3.0_1724264640776.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_keyphrase_gen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_keyphrase_gen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_keyphrase_gen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sunitha98/t5-base-keyphrase-gen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_keyphrase_gen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_keyphrase_gen_pipeline_en.md new file mode 100644 index 00000000000000..74c9fa770509f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_keyphrase_gen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_keyphrase_gen_pipeline pipeline T5Transformer from sunitha98 +author: John Snow Labs +name: t5_base_keyphrase_gen_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_keyphrase_gen_pipeline` is a English model originally trained by sunitha98. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_keyphrase_gen_pipeline_en_5.4.2_3.0_1724264691515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_keyphrase_gen_pipeline_en_5.4.2_3.0_1724264691515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_keyphrase_gen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_keyphrase_gen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_keyphrase_gen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sunitha98/t5-base-keyphrase-gen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_lyrics_explainer_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_lyrics_explainer_en.md new file mode 100644 index 00000000000000..421c88c914597a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_lyrics_explainer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_lyrics_explainer T5Transformer from igorktech +author: John Snow Labs +name: t5_base_lyrics_explainer +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lyrics_explainer` is a English model originally trained by igorktech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lyrics_explainer_en_5.4.2_3.0_1724274972909.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lyrics_explainer_en_5.4.2_3.0_1724274972909.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_lyrics_explainer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_lyrics_explainer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lyrics_explainer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|908.2 MB| + +## References + +https://huggingface.co/igorktech/t5-base-lyrics-explainer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_lyrics_explainer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_lyrics_explainer_pipeline_en.md new file mode 100644 index 00000000000000..33ff6fe6e0b872 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_lyrics_explainer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_lyrics_explainer_pipeline pipeline T5Transformer from igorktech +author: John Snow Labs +name: t5_base_lyrics_explainer_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lyrics_explainer_pipeline` is a English model originally trained by igorktech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lyrics_explainer_pipeline_en_5.4.2_3.0_1724275015582.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lyrics_explainer_pipeline_en_5.4.2_3.0_1724275015582.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_lyrics_explainer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_lyrics_explainer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lyrics_explainer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|908.2 MB| + +## References + +https://huggingface.co/igorktech/t5-base-lyrics-explainer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_ncc_lm_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_ncc_lm_en.md new file mode 100644 index 00000000000000..393b6725a74f63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_ncc_lm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_ncc_lm T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: t5_base_ncc_lm +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_lm` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_en_5.4.2_3.0_1724246946105.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_en_5.4.2_3.0_1724246946105.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_ncc_lm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_ncc_lm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_lm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/t5_base_NCC_lm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_ncc_lm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_ncc_lm_pipeline_en.md new file mode 100644 index 00000000000000..a95a540e12f361 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_ncc_lm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_ncc_lm_pipeline pipeline T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: t5_base_ncc_lm_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_lm_pipeline` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_pipeline_en_5.4.2_3.0_1724247077667.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_pipeline_en_5.4.2_3.0_1724247077667.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_ncc_lm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_ncc_lm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_lm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/t5_base_NCC_lm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_neutralization_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_neutralization_en.md new file mode 100644 index 00000000000000..fc9003fe825676 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_neutralization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_neutralization T5Transformer from gabriellabollici +author: John Snow Labs +name: t5_base_neutralization +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_neutralization` is a English model originally trained by gabriellabollici. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_neutralization_en_5.4.2_3.0_1724265747581.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_neutralization_en_5.4.2_3.0_1724265747581.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_neutralization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_neutralization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_neutralization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|944.2 MB| + +## References + +https://huggingface.co/gabriellabollici/t5-base-neutralization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_neutralization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_neutralization_pipeline_en.md new file mode 100644 index 00000000000000..3a54676387570a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_neutralization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_neutralization_pipeline pipeline T5Transformer from gabriellabollici +author: John Snow Labs +name: t5_base_neutralization_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_neutralization_pipeline` is a English model originally trained by gabriellabollici. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_neutralization_pipeline_en_5.4.2_3.0_1724265800778.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_neutralization_pipeline_en_5.4.2_3.0_1724265800778.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_neutralization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_neutralization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_neutralization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|944.2 MB| + +## References + +https://huggingface.co/gabriellabollici/t5-base-neutralization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_pointer_mtop_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_pointer_mtop_en.md new file mode 100644 index 00000000000000..d91f3401838605 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_pointer_mtop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_pointer_mtop T5Transformer from WillHeld +author: John Snow Labs +name: t5_base_pointer_mtop +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_pointer_mtop` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_pointer_mtop_en_5.4.2_3.0_1724272583387.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_pointer_mtop_en_5.4.2_3.0_1724272583387.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_pointer_mtop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_pointer_mtop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_pointer_mtop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/WillHeld/t5-base-pointer-mtop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_prompter_aqua_300_repeated_ep2_all_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_prompter_aqua_300_repeated_ep2_all_en.md new file mode 100644 index 00000000000000..2e599781448368 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_prompter_aqua_300_repeated_ep2_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_prompter_aqua_300_repeated_ep2_all T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_prompter_aqua_300_repeated_ep2_all +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_prompter_aqua_300_repeated_ep2_all` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_prompter_aqua_300_repeated_ep2_all_en_5.4.2_3.0_1724233302318.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_prompter_aqua_300_repeated_ep2_all_en_5.4.2_3.0_1724233302318.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_prompter_aqua_300_repeated_ep2_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_prompter_aqua_300_repeated_ep2_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_prompter_aqua_300_repeated_ep2_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|921.6 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-prompter-aqua_300-repeated-ep2-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_prompter_aqua_300_repeated_ep2_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_prompter_aqua_300_repeated_ep2_all_pipeline_en.md new file mode 100644 index 00000000000000..159fb513f391a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_prompter_aqua_300_repeated_ep2_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_prompter_aqua_300_repeated_ep2_all_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_prompter_aqua_300_repeated_ep2_all_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_prompter_aqua_300_repeated_ep2_all_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_prompter_aqua_300_repeated_ep2_all_pipeline_en_5.4.2_3.0_1724233357797.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_prompter_aqua_300_repeated_ep2_all_pipeline_en_5.4.2_3.0_1724233357797.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_prompter_aqua_300_repeated_ep2_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_prompter_aqua_300_repeated_ep2_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_prompter_aqua_300_repeated_ep2_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|921.6 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-prompter-aqua_300-repeated-ep2-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_aas_oficial_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_aas_oficial_en.md new file mode 100644 index 00000000000000..33d939f4783602 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_aas_oficial_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_qg_aas_oficial T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_aas_oficial +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_aas_oficial` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_aas_oficial_en_5.4.2_3.0_1724278917709.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_aas_oficial_en_5.4.2_3.0_1724278917709.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_qg_aas_oficial","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_qg_aas_oficial", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_aas_oficial| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|972.3 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-aas-oficial \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_aas_oficial_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_aas_oficial_pipeline_en.md new file mode 100644 index 00000000000000..1bbb71c99b0349 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_aas_oficial_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_qg_aas_oficial_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_aas_oficial_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_aas_oficial_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_aas_oficial_pipeline_en_5.4.2_3.0_1724278975643.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_aas_oficial_pipeline_en_5.4.2_3.0_1724278975643.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_qg_aas_oficial_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_qg_aas_oficial_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_aas_oficial_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|972.3 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-aas-oficial + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_afrikaans_oficial_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_afrikaans_oficial_en.md new file mode 100644 index 00000000000000..7115eb21d8a2e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_afrikaans_oficial_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_qg_afrikaans_oficial T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_afrikaans_oficial +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_afrikaans_oficial` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_afrikaans_oficial_en_5.4.2_3.0_1724251073175.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_afrikaans_oficial_en_5.4.2_3.0_1724251073175.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_qg_afrikaans_oficial","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_qg_afrikaans_oficial", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_afrikaans_oficial| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|972.4 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-af-oficial \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_afrikaans_oficial_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_afrikaans_oficial_pipeline_en.md new file mode 100644 index 00000000000000..3c7292849865e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_qg_afrikaans_oficial_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_qg_afrikaans_oficial_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: t5_base_qg_afrikaans_oficial_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qg_afrikaans_oficial_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qg_afrikaans_oficial_pipeline_en_5.4.2_3.0_1724251131016.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qg_afrikaans_oficial_pipeline_en_5.4.2_3.0_1724251131016.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_qg_afrikaans_oficial_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_qg_afrikaans_oficial_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qg_afrikaans_oficial_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|972.4 MB| + +## References + +https://huggingface.co/tiagoblima/t5_base-qg-af-oficial + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_bm25_baby_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_bm25_baby_en.md new file mode 100644 index 00000000000000..4125c2e9a9fec9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_bm25_baby_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_baby T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_baby +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_baby` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_baby_en_5.4.2_3.0_1724245626305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_baby_en_5.4.2_3.0_1724245626305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_baby","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_baby", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_baby| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|973.2 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-baby \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_bm25_baby_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_bm25_baby_pipeline_en.md new file mode 100644 index 00000000000000..3ecf4c33fba48b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_bm25_baby_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_baby_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_baby_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_baby_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_baby_pipeline_en_5.4.2_3.0_1724245687509.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_baby_pipeline_en_5.4.2_3.0_1724245687509.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_bm25_baby_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_bm25_baby_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_baby_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|973.2 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-baby + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_tfidf_all_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_tfidf_all_en.md new file mode 100644 index 00000000000000..cdeff33be3fb62 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_tfidf_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_tfidf_all T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_tfidf_all +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_tfidf_all` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_tfidf_all_en_5.4.2_3.0_1724200123039.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_tfidf_all_en_5.4.2_3.0_1724200123039.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_tfidf_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_tfidf_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_tfidf_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-tfidf-all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_tfidf_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_tfidf_all_pipeline_en.md new file mode 100644 index 00000000000000..397f70182e2c55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_rlhf_tfidf_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_tfidf_all_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_tfidf_all_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_tfidf_all_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_tfidf_all_pipeline_en_5.4.2_3.0_1724200175001.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_tfidf_all_pipeline_en_5.4.2_3.0_1724200175001.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_tfidf_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_tfidf_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_tfidf_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-tfidf-all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_split_and_rephrase_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_split_and_rephrase_en.md new file mode 100644 index 00000000000000..74f5d976bc6f06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_split_and_rephrase_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_split_and_rephrase T5Transformer from unikei +author: John Snow Labs +name: t5_base_split_and_rephrase +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_split_and_rephrase` is a English model originally trained by unikei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_split_and_rephrase_en_5.4.2_3.0_1724216910658.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_split_and_rephrase_en_5.4.2_3.0_1724216910658.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_split_and_rephrase","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_split_and_rephrase", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_split_and_rephrase| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/unikei/t5-base-split-and-rephrase \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_split_and_rephrase_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_split_and_rephrase_pipeline_en.md new file mode 100644 index 00000000000000..ee9cf162b3c755 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_split_and_rephrase_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_split_and_rephrase_pipeline pipeline T5Transformer from unikei +author: John Snow Labs +name: t5_base_split_and_rephrase_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_split_and_rephrase_pipeline` is a English model originally trained by unikei. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_split_and_rephrase_pipeline_en_5.4.2_3.0_1724216959756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_split_and_rephrase_pipeline_en_5.4.2_3.0_1724216959756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_split_and_rephrase_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_split_and_rephrase_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_split_and_rephrase_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/unikei/t5-base-split-and-rephrase + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_squad_qag_ep6_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_squad_qag_ep6_en.md new file mode 100644 index 00000000000000..94f36fa8aed69a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_squad_qag_ep6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squad_qag_ep6 T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_squad_qag_ep6 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qag_ep6` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qag_ep6_en_5.4.2_3.0_1724235323252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qag_ep6_en_5.4.2_3.0_1724235323252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squad_qag_ep6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squad_qag_ep6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qag_ep6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|985.7 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-SQuAD-qag-ep6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_squad_qag_ep6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_squad_qag_ep6_pipeline_en.md new file mode 100644 index 00000000000000..89fbbaba51728d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_squad_qag_ep6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squad_qag_ep6_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: t5_base_squad_qag_ep6_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squad_qag_ep6_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squad_qag_ep6_pipeline_en_5.4.2_3.0_1724235379045.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squad_qag_ep6_pipeline_en_5.4.2_3.0_1724235379045.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squad_qag_ep6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squad_qag_ep6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squad_qag_ep6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|985.7 MB| + +## References + +https://huggingface.co/Zekunli/t5-base-SQuAD-qag-ep6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_squadshifts_amazon_qg_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_squadshifts_amazon_qg_en.md new file mode 100644 index 00000000000000..15253baf6caf94 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_squadshifts_amazon_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_squadshifts_amazon_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squadshifts_amazon_qg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squadshifts_amazon_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_amazon_qg_en_5.4.2_3.0_1724209873592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_amazon_qg_en_5.4.2_3.0_1724209873592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_squadshifts_amazon_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_squadshifts_amazon_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squadshifts_amazon_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squadshifts-amazon-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_squadshifts_amazon_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_squadshifts_amazon_qg_pipeline_en.md new file mode 100644 index 00000000000000..249f680c12e272 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_squadshifts_amazon_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_squadshifts_amazon_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_squadshifts_amazon_qg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_squadshifts_amazon_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_amazon_qg_pipeline_en_5.4.2_3.0_1724209922514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_squadshifts_amazon_qg_pipeline_en_5.4.2_3.0_1724209922514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_squadshifts_amazon_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_squadshifts_amazon_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_squadshifts_amazon_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-backup/t5-base-squadshifts-amazon-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_story_cloze_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_story_cloze_en.md new file mode 100644 index 00000000000000..f11dbf4fe7fbfe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_story_cloze_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_story_cloze T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_base_story_cloze +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_story_cloze` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_story_cloze_en_5.4.2_3.0_1724232725314.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_story_cloze_en_5.4.2_3.0_1724232725314.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_story_cloze","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_story_cloze", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_story_cloze| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|971.6 MB| + +## References + +https://huggingface.co/SeongwooKim/T5-base-story_cloze \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_story_cloze_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_story_cloze_pipeline_en.md new file mode 100644 index 00000000000000..29cf10d6937072 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_story_cloze_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_story_cloze_pipeline pipeline T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_base_story_cloze_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_story_cloze_pipeline` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_story_cloze_pipeline_en_5.4.2_3.0_1724232785011.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_story_cloze_pipeline_en_5.4.2_3.0_1724232785011.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_story_cloze_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_story_cloze_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_story_cloze_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|971.6 MB| + +## References + +https://huggingface.co/SeongwooKim/T5-base-story_cloze + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_subjqa_vanilla_restaurants_qg_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_subjqa_vanilla_restaurants_qg_en.md new file mode 100644 index 00000000000000..72b682d31207c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_subjqa_vanilla_restaurants_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_subjqa_vanilla_restaurants_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_vanilla_restaurants_qg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_vanilla_restaurants_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_restaurants_qg_en_5.4.2_3.0_1724243446501.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_restaurants_qg_en_5.4.2_3.0_1724243446501.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_subjqa_vanilla_restaurants_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_subjqa_vanilla_restaurants_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_vanilla_restaurants_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|941.9 MB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-vanilla-restaurants-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_subjqa_vanilla_restaurants_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_subjqa_vanilla_restaurants_qg_pipeline_en.md new file mode 100644 index 00000000000000..2c57732cf388e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_subjqa_vanilla_restaurants_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_subjqa_vanilla_restaurants_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_vanilla_restaurants_qg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_vanilla_restaurants_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_restaurants_qg_pipeline_en_5.4.2_3.0_1724243514640.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_restaurants_qg_pipeline_en_5.4.2_3.0_1724243514640.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_subjqa_vanilla_restaurants_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_subjqa_vanilla_restaurants_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_vanilla_restaurants_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|941.9 MB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-vanilla-restaurants-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_0front_1body_6rear_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_0front_1body_6rear_en.md new file mode 100644 index 00000000000000..e12eff78bda88b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_0front_1body_6rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_6rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_6rear +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_6rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_6rear_en_5.4.2_3.0_1724232862460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_6rear_en_5.4.2_3.0_1724232862460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_6rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_6rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_6rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-6rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_0front_1body_6rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_0front_1body_6rear_pipeline_en.md new file mode 100644 index 00000000000000..30563ee4ab1782 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_0front_1body_6rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_6rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_6rear_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_6rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_6rear_pipeline_en_5.4.2_3.0_1724232911985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_6rear_pipeline_en_5.4.2_3.0_1724232911985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_0front_1body_6rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_0front_1body_6rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_6rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-6rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_11body_0context_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_11body_0context_en.md new file mode 100644 index 00000000000000..d6828c5ead91a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_11body_0context_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_11body_0context T5Transformer from tyoyo +author: John Snow Labs +name: t5_base_tedxjp_11body_0context +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_11body_0context` is a English model originally trained by tyoyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_11body_0context_en_5.4.2_3.0_1724268590131.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_11body_0context_en_5.4.2_3.0_1724268590131.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_11body_0context","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_11body_0context", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_11body_0context| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tyoyo/t5-base-TEDxJP-11body-0context \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_11body_0context_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_11body_0context_pipeline_en.md new file mode 100644 index 00000000000000..b486cdd53bc82f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_11body_0context_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_11body_0context_pipeline pipeline T5Transformer from tyoyo +author: John Snow Labs +name: t5_base_tedxjp_11body_0context_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_11body_0context_pipeline` is a English model originally trained by tyoyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_11body_0context_pipeline_en_5.4.2_3.0_1724268638978.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_11body_0context_pipeline_en_5.4.2_3.0_1724268638978.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_11body_0context_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_11body_0context_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_11body_0context_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tyoyo/t5-base-TEDxJP-11body-0context + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_3front_1body_3rear_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_3front_1body_3rear_en.md new file mode 100644 index 00000000000000..0da26968aefda0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_3front_1body_3rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_3front_1body_3rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_3front_1body_3rear +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_3front_1body_3rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_3front_1body_3rear_en_5.4.2_3.0_1724231836679.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_3front_1body_3rear_en_5.4.2_3.0_1724231836679.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_3front_1body_3rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_3front_1body_3rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_3front_1body_3rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-3front-1body-3rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_3front_1body_3rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_3front_1body_3rear_pipeline_en.md new file mode 100644 index 00000000000000..e7e62cb0c752cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_3front_1body_3rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_3front_1body_3rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_3front_1body_3rear_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_3front_1body_3rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_3front_1body_3rear_pipeline_en_5.4.2_3.0_1724231884941.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_3front_1body_3rear_pipeline_en_5.4.2_3.0_1724231884941.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_3front_1body_3rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_3front_1body_3rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_3front_1body_3rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-3front-1body-3rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_4front_1body_4rear_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_4front_1body_4rear_en.md new file mode 100644 index 00000000000000..8c4bd7b11dfcfb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_4front_1body_4rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_4front_1body_4rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_4front_1body_4rear +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_4front_1body_4rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_4front_1body_4rear_en_5.4.2_3.0_1724233949100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_4front_1body_4rear_en_5.4.2_3.0_1724233949100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_4front_1body_4rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_4front_1body_4rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_4front_1body_4rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-4front-1body-4rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_4front_1body_4rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_4front_1body_4rear_pipeline_en.md new file mode 100644 index 00000000000000..4fa6bc9c41ec6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_4front_1body_4rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_4front_1body_4rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_4front_1body_4rear_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_4front_1body_4rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_4front_1body_4rear_pipeline_en_5.4.2_3.0_1724233997800.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_4front_1body_4rear_pipeline_en_5.4.2_3.0_1724233997800.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_4front_1body_4rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_4front_1body_4rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_4front_1body_4rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-4front-1body-4rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_8front_1body_8rear_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_8front_1body_8rear_en.md new file mode 100644 index 00000000000000..b53070abd08ec4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_8front_1body_8rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_8front_1body_8rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_8front_1body_8rear +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_8front_1body_8rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_8front_1body_8rear_en_5.4.2_3.0_1724220204049.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_8front_1body_8rear_en_5.4.2_3.0_1724220204049.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_8front_1body_8rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_8front_1body_8rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_8front_1body_8rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-8front-1body-8rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_8front_1body_8rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_8front_1body_8rear_pipeline_en.md new file mode 100644 index 00000000000000..faacc98052332d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_tedxjp_8front_1body_8rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_8front_1body_8rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_8front_1body_8rear_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_8front_1body_8rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_8front_1body_8rear_pipeline_en_5.4.2_3.0_1724220253036.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_8front_1body_8rear_pipeline_en_5.4.2_3.0_1724220253036.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_8front_1body_8rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_8front_1body_8rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_8front_1body_8rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-8front-1body-8rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_text_tonga_tonga_islands_graph_low_quality_nan.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_text_tonga_tonga_islands_graph_low_quality_nan.md new file mode 100644 index 00000000000000..b4928c3f2594bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_text_tonga_tonga_islands_graph_low_quality_nan.md @@ -0,0 +1,86 @@ +--- +layout: model +title: None t5_base_text_tonga_tonga_islands_graph_low_quality T5Transformer from Nielzac +author: John Snow Labs +name: t5_base_text_tonga_tonga_islands_graph_low_quality +date: 2024-08-21 +tags: [nan, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nan +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_text_tonga_tonga_islands_graph_low_quality` is a None model originally trained by Nielzac. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_text_tonga_tonga_islands_graph_low_quality_nan_5.4.2_3.0_1724245115932.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_text_tonga_tonga_islands_graph_low_quality_nan_5.4.2_3.0_1724245115932.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_text_tonga_tonga_islands_graph_low_quality","nan") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_text_tonga_tonga_islands_graph_low_quality", "nan") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_text_tonga_tonga_islands_graph_low_quality| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|nan| +|Size:|331.4 MB| + +## References + +https://huggingface.co/Nielzac/t5-base-Text-To-Graph_Low_Quality \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline_nan.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline_nan.md new file mode 100644 index 00000000000000..e396f8d0f57f6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline_nan.md @@ -0,0 +1,69 @@ +--- +layout: model +title: None t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline pipeline T5Transformer from Nielzac +author: John Snow Labs +name: t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline +date: 2024-08-21 +tags: [nan, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: nan +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline` is a None model originally trained by Nielzac. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline_nan_5.4.2_3.0_1724245136137.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline_nan_5.4.2_3.0_1724245136137.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline", lang = "nan") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline", lang = "nan") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_text_tonga_tonga_islands_graph_low_quality_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|nan| +|Size:|331.4 MB| + +## References + +https://huggingface.co/Nielzac/t5-base-Text-To-Graph_Low_Quality + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_wiki2sql_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_wiki2sql_en.md new file mode 100644 index 00000000000000..a9bcbcaa91ef54 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_wiki2sql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_wiki2sql T5Transformer from dima806 +author: John Snow Labs +name: t5_base_wiki2sql +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_wiki2sql` is a English model originally trained by dima806. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_wiki2sql_en_5.4.2_3.0_1724258074729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_wiki2sql_en_5.4.2_3.0_1724258074729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_wiki2sql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_wiki2sql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_wiki2sql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|979.3 MB| + +## References + +https://huggingface.co/dima806/t5-base-wiki2sql \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_wiki2sql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_wiki2sql_pipeline_en.md new file mode 100644 index 00000000000000..81cd9826184fce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_wiki2sql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_wiki2sql_pipeline pipeline T5Transformer from dima806 +author: John Snow Labs +name: t5_base_wiki2sql_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_wiki2sql_pipeline` is a English model originally trained by dima806. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_wiki2sql_pipeline_en_5.4.2_3.0_1724258130712.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_wiki2sql_pipeline_en_5.4.2_3.0_1724258130712.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_wiki2sql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_wiki2sql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_wiki2sql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|979.3 MB| + +## References + +https://huggingface.co/dima806/t5-base-wiki2sql + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_with_title_multi_french_wiki_news_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_with_title_multi_french_wiki_news_en.md new file mode 100644 index 00000000000000..e36120deae3504 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_with_title_multi_french_wiki_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_with_title_multi_french_wiki_news T5Transformer from WikinewsSum +author: John Snow Labs +name: t5_base_with_title_multi_french_wiki_news +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_with_title_multi_french_wiki_news` is a English model originally trained by WikinewsSum. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_french_wiki_news_en_5.4.2_3.0_1724229894433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_french_wiki_news_en_5.4.2_3.0_1724229894433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_with_title_multi_french_wiki_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_with_title_multi_french_wiki_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_with_title_multi_french_wiki_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.1 MB| + +## References + +https://huggingface.co/WikinewsSum/t5-base-with-title-multi-fr-wiki-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_base_with_title_multi_french_wiki_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_base_with_title_multi_french_wiki_news_pipeline_en.md new file mode 100644 index 00000000000000..43199f7465a967 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_base_with_title_multi_french_wiki_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_with_title_multi_french_wiki_news_pipeline pipeline T5Transformer from WikinewsSum +author: John Snow Labs +name: t5_base_with_title_multi_french_wiki_news_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_with_title_multi_french_wiki_news_pipeline` is a English model originally trained by WikinewsSum. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_french_wiki_news_pipeline_en_5.4.2_3.0_1724229946623.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_with_title_multi_french_wiki_news_pipeline_en_5.4.2_3.0_1724229946623.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_with_title_multi_french_wiki_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_with_title_multi_french_wiki_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_with_title_multi_french_wiki_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.1 MB| + +## References + +https://huggingface.co/WikinewsSum/t5-base-with-title-multi-fr-wiki-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_bigpatent_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_bigpatent_en.md new file mode 100644 index 00000000000000..08778be04fd420 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_bigpatent_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_bigpatent T5Transformer from jvelja +author: John Snow Labs +name: t5_bigpatent +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_bigpatent` is a English model originally trained by jvelja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_bigpatent_en_5.4.2_3.0_1724208146507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_bigpatent_en_5.4.2_3.0_1724208146507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_bigpatent","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_bigpatent", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_bigpatent| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jvelja/t5-bigpatent \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_bigpatent_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_bigpatent_pipeline_en.md new file mode 100644 index 00000000000000..be2ffdb3ad6ba4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_bigpatent_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_bigpatent_pipeline pipeline T5Transformer from jvelja +author: John Snow Labs +name: t5_bigpatent_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_bigpatent_pipeline` is a English model originally trained by jvelja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_bigpatent_pipeline_en_5.4.2_3.0_1724208197481.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_bigpatent_pipeline_en_5.4.2_3.0_1724208197481.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_bigpatent_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_bigpatent_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_bigpatent_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jvelja/t5-bigpatent + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_conll_ontonotes_en12_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_conll_ontonotes_en12_en.md new file mode 100644 index 00000000000000..2375356e475758 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_conll_ontonotes_en12_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_conll_ontonotes_en12 T5Transformer from NanaEilish +author: John Snow Labs +name: t5_conll_ontonotes_en12 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_conll_ontonotes_en12` is a English model originally trained by NanaEilish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_conll_ontonotes_en12_en_5.4.2_3.0_1724283527971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_conll_ontonotes_en12_en_5.4.2_3.0_1724283527971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_conll_ontonotes_en12","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_conll_ontonotes_en12", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_conll_ontonotes_en12| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|950.6 MB| + +## References + +https://huggingface.co/NanaEilish/t5_conll_ontonotes_en12 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_conll_ontonotes_en12_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_conll_ontonotes_en12_pipeline_en.md new file mode 100644 index 00000000000000..cd394f05c9c323 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_conll_ontonotes_en12_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_conll_ontonotes_en12_pipeline pipeline T5Transformer from NanaEilish +author: John Snow Labs +name: t5_conll_ontonotes_en12_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_conll_ontonotes_en12_pipeline` is a English model originally trained by NanaEilish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_conll_ontonotes_en12_pipeline_en_5.4.2_3.0_1724283584137.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_conll_ontonotes_en12_pipeline_en_5.4.2_3.0_1724283584137.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_conll_ontonotes_en12_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_conll_ontonotes_en12_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_conll_ontonotes_en12_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|950.6 MB| + +## References + +https://huggingface.co/NanaEilish/t5_conll_ontonotes_en12 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_context_corrector_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_context_corrector_en.md new file mode 100644 index 00000000000000..a7047f03074cc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_context_corrector_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_context_corrector T5Transformer from DeathReaper0965 +author: John Snow Labs +name: t5_context_corrector +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_context_corrector` is a English model originally trained by DeathReaper0965. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_context_corrector_en_5.4.2_3.0_1724218186160.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_context_corrector_en_5.4.2_3.0_1724218186160.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_context_corrector","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_context_corrector", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_context_corrector| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/DeathReaper0965/t5-context-corrector \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_context_corrector_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_context_corrector_pipeline_en.md new file mode 100644 index 00000000000000..159d6a121fac13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_context_corrector_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_context_corrector_pipeline pipeline T5Transformer from DeathReaper0965 +author: John Snow Labs +name: t5_context_corrector_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_context_corrector_pipeline` is a English model originally trained by DeathReaper0965. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_context_corrector_pipeline_en_5.4.2_3.0_1724218237726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_context_corrector_pipeline_en_5.4.2_3.0_1724218237726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_context_corrector_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_context_corrector_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_context_corrector_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/DeathReaper0965/t5-context-corrector + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_dialogue_collect_pipeline_zh.md b/docs/_posts/ahmedlone127/2024-08-21-t5_dialogue_collect_pipeline_zh.md new file mode 100644 index 00000000000000..03493278c6800e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_dialogue_collect_pipeline_zh.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Chinese t5_dialogue_collect_pipeline pipeline T5Transformer from svjack +author: John Snow Labs +name: t5_dialogue_collect_pipeline +date: 2024-08-21 +tags: [zh, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_collect_pipeline` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_collect_pipeline_zh_5.4.2_3.0_1724229334180.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_collect_pipeline_zh_5.4.2_3.0_1724229334180.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_dialogue_collect_pipeline", lang = "zh") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_dialogue_collect_pipeline", lang = "zh") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_collect_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|zh| +|Size:|983.0 MB| + +## References + +https://huggingface.co/svjack/T5-dialogue-collect + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_dialogue_collect_zh.md b/docs/_posts/ahmedlone127/2024-08-21-t5_dialogue_collect_zh.md new file mode 100644 index 00000000000000..f2d1644601593d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_dialogue_collect_zh.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Chinese t5_dialogue_collect T5Transformer from svjack +author: John Snow Labs +name: t5_dialogue_collect +date: 2024-08-21 +tags: [zh, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: zh +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_dialogue_collect` is a Chinese model originally trained by svjack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_dialogue_collect_zh_5.4.2_3.0_1724229280445.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_dialogue_collect_zh_5.4.2_3.0_1724229280445.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_dialogue_collect","zh") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_dialogue_collect", "zh") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_dialogue_collect| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|zh| +|Size:|983.0 MB| + +## References + +https://huggingface.co/svjack/T5-dialogue-collect \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_base_kv16_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_base_kv16_en.md new file mode 100644 index 00000000000000..2262a43b76c372 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_base_kv16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_efficient_base_kv16 T5Transformer from google +author: John Snow Labs +name: t5_efficient_base_kv16 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_base_kv16` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_base_kv16_en_5.4.2_3.0_1724262049234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_base_kv16_en_5.4.2_3.0_1724262049234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_base_kv16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_base_kv16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_base_kv16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|399.7 MB| + +## References + +https://huggingface.co/google/t5-efficient-base-kv16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_base_kv16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_base_kv16_pipeline_en.md new file mode 100644 index 00000000000000..e7ae08d133347f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_base_kv16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_base_kv16_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_base_kv16_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_base_kv16_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_base_kv16_pipeline_en_5.4.2_3.0_1724262184305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_base_kv16_pipeline_en_5.4.2_3.0_1724262184305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_base_kv16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_base_kv16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_base_kv16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|399.7 MB| + +## References + +https://huggingface.co/google/t5-efficient-base-kv16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_mini_nl6_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_mini_nl6_en.md new file mode 100644 index 00000000000000..cd3d980d784d76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_mini_nl6_en.md @@ -0,0 +1,94 @@ +--- +layout: model +title: English T5ForConditionalGeneration Mini Cased model (from google) +author: John Snow Labs +name: t5_efficient_mini_nl6 +date: 2024-08-21 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-efficient-mini-nl6` is a English model originally trained by `google`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_mini_nl6_en_5.4.2_3.0_1724211881691.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_mini_nl6_en_5.4.2_3.0_1724211881691.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_efficient_mini_nl6","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_mini_nl6","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_mini_nl6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|125.3 MB| + +## References + +References + +- https://huggingface.co/google/t5-efficient-mini-nl6 +- https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html +- https://arxiv.org/abs/2109.10686 +- https://arxiv.org/abs/2109.10686 +- https://github.com/google-research/google-research/issues/986#issuecomment-1035051145 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_mini_nl6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_mini_nl6_pipeline_en.md new file mode 100644 index 00000000000000..eee433e76e39b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_mini_nl6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_mini_nl6_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_mini_nl6_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_mini_nl6_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_mini_nl6_pipeline_en_5.4.2_3.0_1724211924834.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_mini_nl6_pipeline_en_5.4.2_3.0_1724211924834.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_mini_nl6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_mini_nl6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_mini_nl6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|125.3 MB| + +## References + +https://huggingface.co/google/t5-efficient-mini-nl6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_small_dewiki_v1_de.md b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_small_dewiki_v1_de.md new file mode 100644 index 00000000000000..674583f399d844 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_small_dewiki_v1_de.md @@ -0,0 +1,86 @@ +--- +layout: model +title: German t5_efficient_small_dewiki_v1 T5Transformer from gwlms +author: John Snow Labs +name: t5_efficient_small_dewiki_v1 +date: 2024-08-21 +tags: [de, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_small_dewiki_v1` is a German model originally trained by gwlms. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_small_dewiki_v1_de_5.4.2_3.0_1724227605891.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_small_dewiki_v1_de_5.4.2_3.0_1724227605891.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_efficient_small_dewiki_v1","de") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_small_dewiki_v1", "de") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_small_dewiki_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|de| +|Size:|337.0 MB| + +## References + +https://huggingface.co/gwlms/t5-efficient-small-dewiki-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_small_dewiki_v1_pipeline_de.md b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_small_dewiki_v1_pipeline_de.md new file mode 100644 index 00000000000000..a0fb26088b7ca1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_small_dewiki_v1_pipeline_de.md @@ -0,0 +1,69 @@ +--- +layout: model +title: German t5_efficient_small_dewiki_v1_pipeline pipeline T5Transformer from gwlms +author: John Snow Labs +name: t5_efficient_small_dewiki_v1_pipeline +date: 2024-08-21 +tags: [de, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: de +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_small_dewiki_v1_pipeline` is a German model originally trained by gwlms. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_small_dewiki_v1_pipeline_de_5.4.2_3.0_1724227720214.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_small_dewiki_v1_pipeline_de_5.4.2_3.0_1724227720214.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_small_dewiki_v1_pipeline", lang = "de") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_small_dewiki_v1_pipeline", lang = "de") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_small_dewiki_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|de| +|Size:|337.0 MB| + +## References + +https://huggingface.co/gwlms/t5-efficient-small-dewiki-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_tiny_nl6_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_tiny_nl6_en.md new file mode 100644 index 00000000000000..c172cb0502d27b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_tiny_nl6_en.md @@ -0,0 +1,94 @@ +--- +layout: model +title: English T5ForConditionalGeneration Tiny Cased model (from google) +author: John Snow Labs +name: t5_efficient_tiny_nl6 +date: 2024-08-21 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-efficient-tiny-nl6` is a English model originally trained by `google`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_tiny_nl6_en_5.4.2_3.0_1724214331089.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_tiny_nl6_en_5.4.2_3.0_1724214331089.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_efficient_tiny_nl6","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_efficient_tiny_nl6","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_tiny_nl6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|68.6 MB| + +## References + +References + +- https://huggingface.co/google/t5-efficient-tiny-nl6 +- https://ai.googleblog.com/2020/02/exploring-transfer-learning-with-t5.html +- https://arxiv.org/abs/2109.10686 +- https://arxiv.org/abs/2109.10686 +- https://github.com/google-research/google-research/issues/986#issuecomment-1035051145 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_tiny_nl6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_tiny_nl6_pipeline_en.md new file mode 100644 index 00000000000000..22ea66ba02804b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_efficient_tiny_nl6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_efficient_tiny_nl6_pipeline pipeline T5Transformer from google +author: John Snow Labs +name: t5_efficient_tiny_nl6_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_efficient_tiny_nl6_pipeline` is a English model originally trained by google. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_efficient_tiny_nl6_pipeline_en_5.4.2_3.0_1724214360851.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_efficient_tiny_nl6_pipeline_en_5.4.2_3.0_1724214360851.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_efficient_tiny_nl6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_efficient_tiny_nl6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_efficient_tiny_nl6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|68.6 MB| + +## References + +https://huggingface.co/google/t5-efficient-tiny-nl6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_estonian_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_estonian_en.md new file mode 100644 index 00000000000000..39c82a9e240ff5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_estonian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_estonian T5Transformer from Shitba +author: John Snow Labs +name: t5_estonian +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_estonian` is a English model originally trained by Shitba. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_estonian_en_5.4.2_3.0_1724252118265.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_estonian_en_5.4.2_3.0_1724252118265.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_estonian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_estonian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_estonian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|118.9 MB| + +## References + +https://huggingface.co/Shitba/T5-ET \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_estonian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_estonian_pipeline_en.md new file mode 100644 index 00000000000000..d33a1a0268f3be --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_estonian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_estonian_pipeline pipeline T5Transformer from Shitba +author: John Snow Labs +name: t5_estonian_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_estonian_pipeline` is a English model originally trained by Shitba. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_estonian_pipeline_en_5.4.2_3.0_1724252124494.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_estonian_pipeline_en_5.4.2_3.0_1724252124494.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_estonian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_estonian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_estonian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|118.9 MB| + +## References + +https://huggingface.co/Shitba/T5-ET + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_experience_extraction_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_experience_extraction_en.md new file mode 100644 index 00000000000000..2931a2b47768f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_experience_extraction_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_experience_extraction T5Transformer from ManulaPankaja +author: John Snow Labs +name: t5_experience_extraction +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_experience_extraction` is a English model originally trained by ManulaPankaja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_experience_extraction_en_5.4.2_3.0_1724230170508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_experience_extraction_en_5.4.2_3.0_1724230170508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_experience_extraction","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_experience_extraction", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_experience_extraction| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|985.4 MB| + +## References + +https://huggingface.co/ManulaPankaja/t5_experience_extraction \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_experience_extraction_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_experience_extraction_pipeline_en.md new file mode 100644 index 00000000000000..156bb939940333 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_experience_extraction_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_experience_extraction_pipeline pipeline T5Transformer from ManulaPankaja +author: John Snow Labs +name: t5_experience_extraction_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_experience_extraction_pipeline` is a English model originally trained by ManulaPankaja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_experience_extraction_pipeline_en_5.4.2_3.0_1724230223451.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_experience_extraction_pipeline_en_5.4.2_3.0_1724230223451.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_experience_extraction_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_experience_extraction_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_experience_extraction_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|985.4 MB| + +## References + +https://huggingface.co/ManulaPankaja/t5_experience_extraction + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_finetuned_meetings_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_finetuned_meetings_en.md new file mode 100644 index 00000000000000..a3435ea8fdd321 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_finetuned_meetings_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetuned_meetings T5Transformer from jainr3 +author: John Snow Labs +name: t5_finetuned_meetings +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_meetings` is a English model originally trained by jainr3. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_meetings_en_5.4.2_3.0_1724260060488.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_meetings_en_5.4.2_3.0_1724260060488.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetuned_meetings","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetuned_meetings", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_meetings| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jainr3/t5-finetuned-meetings \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_finetuned_meetings_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_finetuned_meetings_pipeline_en.md new file mode 100644 index 00000000000000..fbaaa5749cc83f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_finetuned_meetings_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetuned_meetings_pipeline pipeline T5Transformer from jainr3 +author: John Snow Labs +name: t5_finetuned_meetings_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_meetings_pipeline` is a English model originally trained by jainr3. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_meetings_pipeline_en_5.4.2_3.0_1724260110224.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_meetings_pipeline_en_5.4.2_3.0_1724260110224.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetuned_meetings_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetuned_meetings_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_meetings_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jainr3/t5-finetuned-meetings + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_gas_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_gas_v1_en.md new file mode 100644 index 00000000000000..44094264261b25 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_gas_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_gas_v1 T5Transformer from kisejin +author: John Snow Labs +name: t5_gas_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_gas_v1` is a English model originally trained by kisejin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_gas_v1_en_5.4.2_3.0_1724278819734.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_gas_v1_en_5.4.2_3.0_1724278819734.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_gas_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_gas_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_gas_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|990.9 MB| + +## References + +https://huggingface.co/kisejin/T5-GAS-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_gas_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_gas_v1_pipeline_en.md new file mode 100644 index 00000000000000..d618cfaf297f6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_gas_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_gas_v1_pipeline pipeline T5Transformer from kisejin +author: John Snow Labs +name: t5_gas_v1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_gas_v1_pipeline` is a English model originally trained by kisejin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_gas_v1_pipeline_en_5.4.2_3.0_1724278873311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_gas_v1_pipeline_en_5.4.2_3.0_1724278873311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_gas_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_gas_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_gas_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|990.9 MB| + +## References + +https://huggingface.co/kisejin/T5-GAS-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_german_paraphraser_large_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_german_paraphraser_large_en.md new file mode 100644 index 00000000000000..f16217407e4874 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_german_paraphraser_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_german_paraphraser_large T5Transformer from Lelon +author: John Snow Labs +name: t5_german_paraphraser_large +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_german_paraphraser_large` is a English model originally trained by Lelon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_german_paraphraser_large_en_5.4.2_3.0_1724216545616.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_german_paraphraser_large_en_5.4.2_3.0_1724216545616.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_german_paraphraser_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_german_paraphraser_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_german_paraphraser_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Lelon/t5-german-paraphraser-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_german_paraphraser_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_german_paraphraser_large_pipeline_en.md new file mode 100644 index 00000000000000..03abb6068a16a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_german_paraphraser_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_german_paraphraser_large_pipeline pipeline T5Transformer from Lelon +author: John Snow Labs +name: t5_german_paraphraser_large_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_german_paraphraser_large_pipeline` is a English model originally trained by Lelon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_german_paraphraser_large_pipeline_en_5.4.2_3.0_1724216704055.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_german_paraphraser_large_pipeline_en_5.4.2_3.0_1724216704055.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_german_paraphraser_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_german_paraphraser_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_german_paraphraser_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Lelon/t5-german-paraphraser-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_it5_efficient_small_el32_question_answering_it.md b/docs/_posts/ahmedlone127/2024-08-21-t5_it5_efficient_small_el32_question_answering_it.md new file mode 100644 index 00000000000000..d5b32b2a5807e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_it5_efficient_small_el32_question_answering_it.md @@ -0,0 +1,96 @@ +--- +layout: model +title: Italian T5ForConditionalGeneration Small Cased model (from it5) +author: John Snow Labs +name: t5_it5_efficient_small_el32_question_answering +date: 2024-08-21 +tags: [it, open_source, t5, onnx] +task: Text Generation +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `it5-efficient-small-el32-question-answering` is a Italian model originally trained by `it5`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_it5_efficient_small_el32_question_answering_it_5.4.2_3.0_1724217105827.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_it5_efficient_small_el32_question_answering_it_5.4.2_3.0_1724217105827.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_it5_efficient_small_el32_question_answering","it") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_it5_efficient_small_el32_question_answering","it") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_it5_efficient_small_el32_question_answering| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|654.8 MB| + +## References + +References + +- https://huggingface.co/it5/it5-efficient-small-el32-question-answering +- https://github.com/stefan-it +- https://arxiv.org/abs/2203.03759 +- https://gsarti.com +- https://malvinanissim.github.io +- https://github.com/gsarti/it5 +- https://paperswithcode.com/sota?task=Question+Answering&dataset=SQuAD-IT \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_it5_efficient_small_el32_question_answering_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-21-t5_it5_efficient_small_el32_question_answering_pipeline_it.md new file mode 100644 index 00000000000000..2536822d7830cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_it5_efficient_small_el32_question_answering_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian t5_it5_efficient_small_el32_question_answering_pipeline pipeline T5Transformer from it5 +author: John Snow Labs +name: t5_it5_efficient_small_el32_question_answering_pipeline +date: 2024-08-21 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_it5_efficient_small_el32_question_answering_pipeline` is a Italian model originally trained by it5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_it5_efficient_small_el32_question_answering_pipeline_it_5.4.2_3.0_1724217136135.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_it5_efficient_small_el32_question_answering_pipeline_it_5.4.2_3.0_1724217136135.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_it5_efficient_small_el32_question_answering_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_it5_efficient_small_el32_question_answering_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_it5_efficient_small_el32_question_answering_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|654.8 MB| + +## References + +https://huggingface.co/it5/it5-efficient-small-el32-question-answering + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_k2t_test3_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_k2t_test3_en.md new file mode 100644 index 00000000000000..b3768161cdb982 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_k2t_test3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_k2t_test3 T5Transformer from gagan3012 +author: John Snow Labs +name: t5_k2t_test3 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_k2t_test3` is a English model originally trained by gagan3012. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_k2t_test3_en_5.4.2_3.0_1724212662996.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_k2t_test3_en_5.4.2_3.0_1724212662996.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_k2t_test3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_k2t_test3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_k2t_test3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|287.2 MB| + +## References + +https://huggingface.co/gagan3012/k2t-test3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_k2t_test3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_k2t_test3_pipeline_en.md new file mode 100644 index 00000000000000..235e6d1ac396d8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_k2t_test3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_k2t_test3_pipeline pipeline T5Transformer from gagan3012 +author: John Snow Labs +name: t5_k2t_test3_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_k2t_test3_pipeline` is a English model originally trained by gagan3012. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_k2t_test3_pipeline_en_5.4.2_3.0_1724212695853.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_k2t_test3_pipeline_en_5.4.2_3.0_1724212695853.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_k2t_test3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_k2t_test3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_k2t_test3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|287.2 MB| + +## References + +https://huggingface.co/gagan3012/k2t-test3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_20_epochs_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_20_epochs_en.md new file mode 100644 index 00000000000000..cf270c9190f892 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_20_epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_20_epochs T5Transformer from dratinox +author: John Snow Labs +name: t5_large_20_epochs +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_20_epochs` is a English model originally trained by dratinox. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_20_epochs_en_5.4.2_3.0_1724237008465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_20_epochs_en_5.4.2_3.0_1724237008465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_20_epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_20_epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_20_epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/dratinox/t5_large_20_epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_20_epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_20_epochs_pipeline_en.md new file mode 100644 index 00000000000000..1718096942a574 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_20_epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_20_epochs_pipeline pipeline T5Transformer from dratinox +author: John Snow Labs +name: t5_large_20_epochs_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_20_epochs_pipeline` is a English model originally trained by dratinox. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_20_epochs_pipeline_en_5.4.2_3.0_1724237152537.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_20_epochs_pipeline_en_5.4.2_3.0_1724237152537.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_20_epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_20_epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_20_epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/dratinox/t5_large_20_epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_data_v3_model_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_data_v3_model_v1_en.md new file mode 100644 index 00000000000000..01eed15038dc6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_data_v3_model_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_data_v3_model_v1 T5Transformer from CareerNinja +author: John Snow Labs +name: t5_large_data_v3_model_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_data_v3_model_v1` is a English model originally trained by CareerNinja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_data_v3_model_v1_en_5.4.2_3.0_1724259335608.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_data_v3_model_v1_en_5.4.2_3.0_1724259335608.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_data_v3_model_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_data_v3_model_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_data_v3_model_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/CareerNinja/T5-Large-data-v3-model-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_data_v3_model_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_data_v3_model_v1_pipeline_en.md new file mode 100644 index 00000000000000..35c44bcb2e76d9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_data_v3_model_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_data_v3_model_v1_pipeline pipeline T5Transformer from CareerNinja +author: John Snow Labs +name: t5_large_data_v3_model_v1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_data_v3_model_v1_pipeline` is a English model originally trained by CareerNinja. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_data_v3_model_v1_pipeline_en_5.4.2_3.0_1724259494069.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_data_v3_model_v1_pipeline_en_5.4.2_3.0_1724259494069.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_data_v3_model_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_data_v3_model_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_data_v3_model_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/CareerNinja/T5-Large-data-v3-model-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_fine_tuned_wnut_2020_task3_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_fine_tuned_wnut_2020_task3_en.md new file mode 100644 index 00000000000000..e4577be9e01e49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_fine_tuned_wnut_2020_task3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_fine_tuned_wnut_2020_task3 T5Transformer from congcongwang +author: John Snow Labs +name: t5_large_fine_tuned_wnut_2020_task3 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_fine_tuned_wnut_2020_task3` is a English model originally trained by congcongwang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_fine_tuned_wnut_2020_task3_en_5.4.2_3.0_1724263047845.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_fine_tuned_wnut_2020_task3_en_5.4.2_3.0_1724263047845.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_fine_tuned_wnut_2020_task3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_fine_tuned_wnut_2020_task3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_fine_tuned_wnut_2020_task3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/congcongwang/t5-large-fine-tuned-wnut-2020-task3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_fine_tuned_wnut_2020_task3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_fine_tuned_wnut_2020_task3_pipeline_en.md new file mode 100644 index 00000000000000..3d8215577d9349 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_fine_tuned_wnut_2020_task3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_fine_tuned_wnut_2020_task3_pipeline pipeline T5Transformer from congcongwang +author: John Snow Labs +name: t5_large_fine_tuned_wnut_2020_task3_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_fine_tuned_wnut_2020_task3_pipeline` is a English model originally trained by congcongwang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_fine_tuned_wnut_2020_task3_pipeline_en_5.4.2_3.0_1724263192540.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_fine_tuned_wnut_2020_task3_pipeline_en_5.4.2_3.0_1724263192540.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_fine_tuned_wnut_2020_task3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_fine_tuned_wnut_2020_task3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_fine_tuned_wnut_2020_task3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/congcongwang/t5-large-fine-tuned-wnut-2020-task3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_finetuned_bias_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_finetuned_bias_en.md new file mode 100644 index 00000000000000..7957387db48452 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_finetuned_bias_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_finetuned_bias T5Transformer from erickfm +author: John Snow Labs +name: t5_large_finetuned_bias +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_finetuned_bias` is a English model originally trained by erickfm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_finetuned_bias_en_5.4.2_3.0_1724244128072.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_finetuned_bias_en_5.4.2_3.0_1724244128072.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_finetuned_bias","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_finetuned_bias", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_finetuned_bias| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/erickfm/t5-large-finetuned-bias \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_finetuned_bias_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_finetuned_bias_pipeline_en.md new file mode 100644 index 00000000000000..837d6b7e9538d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_finetuned_bias_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_finetuned_bias_pipeline pipeline T5Transformer from erickfm +author: John Snow Labs +name: t5_large_finetuned_bias_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_finetuned_bias_pipeline` is a English model originally trained by erickfm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_finetuned_bias_pipeline_en_5.4.2_3.0_1724244266266.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_finetuned_bias_pipeline_en_5.4.2_3.0_1724244266266.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_finetuned_bias_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_finetuned_bias_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_finetuned_bias_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/erickfm/t5-large-finetuned-bias + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_hoax_def_classifier_v1_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_hoax_def_classifier_v1_en.md new file mode 100644 index 00000000000000..e66d217f7bc4f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_hoax_def_classifier_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_hoax_def_classifier_v1 T5Transformer from research-dump +author: John Snow Labs +name: t5_large_hoax_def_classifier_v1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_hoax_def_classifier_v1` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_hoax_def_classifier_v1_en_5.4.2_3.0_1724278600694.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_hoax_def_classifier_v1_en_5.4.2_3.0_1724278600694.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_hoax_def_classifier_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_hoax_def_classifier_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_hoax_def_classifier_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/research-dump/t5-large_hoax_def_classifier_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_hoax_def_classifier_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_hoax_def_classifier_v1_pipeline_en.md new file mode 100644 index 00000000000000..d2469853f0772a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_hoax_def_classifier_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_hoax_def_classifier_v1_pipeline pipeline T5Transformer from research-dump +author: John Snow Labs +name: t5_large_hoax_def_classifier_v1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_hoax_def_classifier_v1_pipeline` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_hoax_def_classifier_v1_pipeline_en_5.4.2_3.0_1724278750127.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_hoax_def_classifier_v1_pipeline_en_5.4.2_3.0_1724278750127.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_hoax_def_classifier_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_hoax_def_classifier_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_hoax_def_classifier_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/research-dump/t5-large_hoax_def_classifier_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_lm_adapt_musique_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_lm_adapt_musique_en.md new file mode 100644 index 00000000000000..261d53a8fe8b1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_lm_adapt_musique_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_lm_adapt_musique T5Transformer from sauravjoshi23 +author: John Snow Labs +name: t5_large_lm_adapt_musique +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_lm_adapt_musique` is a English model originally trained by sauravjoshi23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_musique_en_5.4.2_3.0_1724265281035.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_musique_en_5.4.2_3.0_1724265281035.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_lm_adapt_musique","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_lm_adapt_musique", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_lm_adapt_musique| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sauravjoshi23/t5-large-lm-adapt-musique \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_lm_adapt_musique_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_lm_adapt_musique_pipeline_en.md new file mode 100644 index 00000000000000..988859ca6e1bc1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_lm_adapt_musique_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_lm_adapt_musique_pipeline pipeline T5Transformer from sauravjoshi23 +author: John Snow Labs +name: t5_large_lm_adapt_musique_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_lm_adapt_musique_pipeline` is a English model originally trained by sauravjoshi23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_musique_pipeline_en_5.4.2_3.0_1724265429670.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_lm_adapt_musique_pipeline_en_5.4.2_3.0_1724265429670.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_lm_adapt_musique_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_lm_adapt_musique_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_lm_adapt_musique_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sauravjoshi23/t5-large-lm-adapt-musique + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_paraphraser_diverse_high_quality_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_paraphraser_diverse_high_quality_en.md new file mode 100644 index 00000000000000..6bf41506b296af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_paraphraser_diverse_high_quality_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_paraphraser_diverse_high_quality T5Transformer from ramsrigouthamg +author: John Snow Labs +name: t5_large_paraphraser_diverse_high_quality +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_paraphraser_diverse_high_quality` is a English model originally trained by ramsrigouthamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_paraphraser_diverse_high_quality_en_5.4.2_3.0_1724216041892.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_paraphraser_diverse_high_quality_en_5.4.2_3.0_1724216041892.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_paraphraser_diverse_high_quality","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_paraphraser_diverse_high_quality", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_paraphraser_diverse_high_quality| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ramsrigouthamg/t5-large-paraphraser-diverse-high-quality \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_paraphraser_diverse_high_quality_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_paraphraser_diverse_high_quality_pipeline_en.md new file mode 100644 index 00000000000000..971e4821201e6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_paraphraser_diverse_high_quality_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_paraphraser_diverse_high_quality_pipeline pipeline T5Transformer from ramsrigouthamg +author: John Snow Labs +name: t5_large_paraphraser_diverse_high_quality_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_paraphraser_diverse_high_quality_pipeline` is a English model originally trained by ramsrigouthamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_paraphraser_diverse_high_quality_pipeline_en_5.4.2_3.0_1724216182285.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_paraphraser_diverse_high_quality_pipeline_en_5.4.2_3.0_1724216182285.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_paraphraser_diverse_high_quality_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_paraphraser_diverse_high_quality_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_paraphraser_diverse_high_quality_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ramsrigouthamg/t5-large-paraphraser-diverse-high-quality + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_qg_aap_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_qg_aap_en.md new file mode 100644 index 00000000000000..a9cff08167b4e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_qg_aap_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_qg_aap T5Transformer from tiagoblima +author: John Snow Labs +name: t5_large_qg_aap +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_qg_aap` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_qg_aap_en_5.4.2_3.0_1724200497745.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_qg_aap_en_5.4.2_3.0_1724200497745.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_qg_aap","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_qg_aap", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_qg_aap| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.8 GB| + +## References + +https://huggingface.co/tiagoblima/t5_large-qg-aap \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_ai_cardiothoracic_0_8_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_ai_cardiothoracic_0_8_en.md new file mode 100644 index 00000000000000..defcf5676e5480 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_ai_cardiothoracic_0_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_radiology_ai_cardiothoracic_0_8 T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_radiology_ai_cardiothoracic_0_8 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_radiology_ai_cardiothoracic_0_8` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_radiology_ai_cardiothoracic_0_8_en_5.4.2_3.0_1724243025908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_radiology_ai_cardiothoracic_0_8_en_5.4.2_3.0_1724243025908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_radiology_ai_cardiothoracic_0_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_radiology_ai_cardiothoracic_0_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_radiology_ai_cardiothoracic_0_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_radiology-ai-cardiothoracic-0.8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_ai_cardiothoracic_0_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_ai_cardiothoracic_0_8_pipeline_en.md new file mode 100644 index 00000000000000..09772df1bd5f23 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_ai_cardiothoracic_0_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_radiology_ai_cardiothoracic_0_8_pipeline pipeline T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_radiology_ai_cardiothoracic_0_8_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_radiology_ai_cardiothoracic_0_8_pipeline` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_radiology_ai_cardiothoracic_0_8_pipeline_en_5.4.2_3.0_1724243197175.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_radiology_ai_cardiothoracic_0_8_pipeline_en_5.4.2_3.0_1724243197175.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_radiology_ai_cardiothoracic_0_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_radiology_ai_cardiothoracic_0_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_radiology_ai_cardiothoracic_0_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_radiology-ai-cardiothoracic-0.8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_cardiothoracic_imagingcancer_0_9_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_cardiothoracic_imagingcancer_0_9_en.md new file mode 100644 index 00000000000000..449484b5ffb18b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_cardiothoracic_imagingcancer_0_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_radiology_cardiothoracic_imagingcancer_0_9 T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_radiology_cardiothoracic_imagingcancer_0_9 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_radiology_cardiothoracic_imagingcancer_0_9` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_radiology_cardiothoracic_imagingcancer_0_9_en_5.4.2_3.0_1724241234737.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_radiology_cardiothoracic_imagingcancer_0_9_en_5.4.2_3.0_1724241234737.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_radiology_cardiothoracic_imagingcancer_0_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_radiology_cardiothoracic_imagingcancer_0_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_radiology_cardiothoracic_imagingcancer_0_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_radiology-cardiothoracic-imagingcancer-0.9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline_en.md new file mode 100644 index 00000000000000..aa35d640fd109f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline pipeline T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline_en_5.4.2_3.0_1724241394231.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline_en_5.4.2_3.0_1724241394231.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_radiology_cardiothoracic_imagingcancer_0_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_radiology-cardiothoracic-imagingcancer-0.9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_squad_qag_ep6_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_squad_qag_ep6_en.md new file mode 100644 index 00000000000000..f3ef879f765d14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_squad_qag_ep6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_squad_qag_ep6 T5Transformer from Zekunli +author: John Snow Labs +name: t5_large_squad_qag_ep6 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squad_qag_ep6` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squad_qag_ep6_en_5.4.2_3.0_1724263511422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squad_qag_ep6_en_5.4.2_3.0_1724263511422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_squad_qag_ep6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_squad_qag_ep6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squad_qag_ep6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Zekunli/t5-large-SQuAD-qag-ep6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_squad_qag_ep6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_squad_qag_ep6_pipeline_en.md new file mode 100644 index 00000000000000..27fb5c7243bcd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_squad_qag_ep6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_squad_qag_ep6_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: t5_large_squad_qag_ep6_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_squad_qag_ep6_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_squad_qag_ep6_pipeline_en_5.4.2_3.0_1724263650080.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_squad_qag_ep6_pipeline_en_5.4.2_3.0_1724263650080.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_squad_qag_ep6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_squad_qag_ep6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_squad_qag_ep6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Zekunli/t5-large-SQuAD-qag-ep6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_electronics_qg_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_electronics_qg_en.md new file mode 100644 index 00000000000000..1c3307172d7d9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_electronics_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_subjqa_electronics_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_electronics_qg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_electronics_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_electronics_qg_en_5.4.2_3.0_1724253037917.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_electronics_qg_en_5.4.2_3.0_1724253037917.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_subjqa_electronics_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_subjqa_electronics_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_electronics_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-electronics-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_electronics_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_electronics_qg_pipeline_en.md new file mode 100644 index 00000000000000..cd420aa7e095ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_electronics_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_subjqa_electronics_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_electronics_qg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_electronics_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_electronics_qg_pipeline_en_5.4.2_3.0_1724253170394.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_electronics_qg_pipeline_en_5.4.2_3.0_1724253170394.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_subjqa_electronics_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_subjqa_electronics_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_electronics_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-electronics-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_tripadvisor_qg_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_tripadvisor_qg_en.md new file mode 100644 index 00000000000000..90c3f0dbe913da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_tripadvisor_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_subjqa_tripadvisor_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_tripadvisor_qg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_tripadvisor_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_tripadvisor_qg_en_5.4.2_3.0_1724251496030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_tripadvisor_qg_en_5.4.2_3.0_1724251496030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_subjqa_tripadvisor_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_subjqa_tripadvisor_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_tripadvisor_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-tripadvisor-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_tripadvisor_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_tripadvisor_qg_pipeline_en.md new file mode 100644 index 00000000000000..07e5aafd6ec37f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_tripadvisor_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_subjqa_tripadvisor_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_tripadvisor_qg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_tripadvisor_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_tripadvisor_qg_pipeline_en_5.4.2_3.0_1724251657179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_tripadvisor_qg_pipeline_en_5.4.2_3.0_1724251657179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_subjqa_tripadvisor_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_subjqa_tripadvisor_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_tripadvisor_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-tripadvisor-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_vanilla_grocery_qg_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_vanilla_grocery_qg_en.md new file mode 100644 index 00000000000000..aa4475d81a68c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_vanilla_grocery_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_subjqa_vanilla_grocery_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_vanilla_grocery_qg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_vanilla_grocery_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_vanilla_grocery_qg_en_5.4.2_3.0_1724232704304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_vanilla_grocery_qg_en_5.4.2_3.0_1724232704304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_subjqa_vanilla_grocery_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_subjqa_vanilla_grocery_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_vanilla_grocery_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-vanilla-grocery-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_vanilla_grocery_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_vanilla_grocery_qg_pipeline_en.md new file mode 100644 index 00000000000000..06f1d083584cb3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_large_subjqa_vanilla_grocery_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_subjqa_vanilla_grocery_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_vanilla_grocery_qg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_vanilla_grocery_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_vanilla_grocery_qg_pipeline_en_5.4.2_3.0_1724232870631.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_vanilla_grocery_qg_pipeline_en_5.4.2_3.0_1724232870631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_subjqa_vanilla_grocery_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_subjqa_vanilla_grocery_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_vanilla_grocery_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-vanilla-grocery-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_logisgenerator_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_logisgenerator_en.md new file mode 100644 index 00000000000000..1c1bc9a27a7e2d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_logisgenerator_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_logisgenerator T5Transformer from OnsElleuch +author: John Snow Labs +name: t5_logisgenerator +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_logisgenerator` is a English model originally trained by OnsElleuch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_logisgenerator_en_5.4.2_3.0_1724214640046.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_logisgenerator_en_5.4.2_3.0_1724214640046.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_logisgenerator","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_logisgenerator", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_logisgenerator| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.4 MB| + +## References + +https://huggingface.co/OnsElleuch/logisgenerator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_logisgenerator_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_logisgenerator_pipeline_en.md new file mode 100644 index 00000000000000..eed7d8d89b7b7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_logisgenerator_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_logisgenerator_pipeline pipeline T5Transformer from OnsElleuch +author: John Snow Labs +name: t5_logisgenerator_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_logisgenerator_pipeline` is a English model originally trained by OnsElleuch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_logisgenerator_pipeline_en_5.4.2_3.0_1724214659784.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_logisgenerator_pipeline_en_5.4.2_3.0_1724214659784.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_logisgenerator_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_logisgenerator_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_logisgenerator_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.4 MB| + +## References + +https://huggingface.co/OnsElleuch/logisgenerator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_mask_cnn_dailymail_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_mask_cnn_dailymail_en.md new file mode 100644 index 00000000000000..e6d33c789e0116 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_mask_cnn_dailymail_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_mask_cnn_dailymail T5Transformer from yliu337 +author: John Snow Labs +name: t5_mask_cnn_dailymail +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mask_cnn_dailymail` is a English model originally trained by yliu337. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mask_cnn_dailymail_en_5.4.2_3.0_1724230402760.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mask_cnn_dailymail_en_5.4.2_3.0_1724230402760.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_mask_cnn_dailymail","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_mask_cnn_dailymail", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mask_cnn_dailymail| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yliu337/t5_mask_cnn_dailymail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_mask_cnn_dailymail_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_mask_cnn_dailymail_pipeline_en.md new file mode 100644 index 00000000000000..1d6cc0418a776e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_mask_cnn_dailymail_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_mask_cnn_dailymail_pipeline pipeline T5Transformer from yliu337 +author: John Snow Labs +name: t5_mask_cnn_dailymail_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_mask_cnn_dailymail_pipeline` is a English model originally trained by yliu337. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_mask_cnn_dailymail_pipeline_en_5.4.2_3.0_1724230451585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_mask_cnn_dailymail_pipeline_en_5.4.2_3.0_1724230451585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_mask_cnn_dailymail_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_mask_cnn_dailymail_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_mask_cnn_dailymail_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/yliu337/t5_mask_cnn_dailymail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_metaphor_large_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_metaphor_large_en.md new file mode 100644 index 00000000000000..d41f111e7dbc19 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_metaphor_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_metaphor_large T5Transformer from tlkh +author: John Snow Labs +name: t5_metaphor_large +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_metaphor_large` is a English model originally trained by tlkh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_metaphor_large_en_5.4.2_3.0_1724254382995.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_metaphor_large_en_5.4.2_3.0_1724254382995.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_metaphor_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_metaphor_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_metaphor_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/tlkh/t5-metaphor-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_metaphor_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_metaphor_large_pipeline_en.md new file mode 100644 index 00000000000000..15b88d13bd6039 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_metaphor_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_metaphor_large_pipeline pipeline T5Transformer from tlkh +author: John Snow Labs +name: t5_metaphor_large_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_metaphor_large_pipeline` is a English model originally trained by tlkh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_metaphor_large_pipeline_en_5.4.2_3.0_1724254537084.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_metaphor_large_pipeline_en_5.4.2_3.0_1724254537084.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_metaphor_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_metaphor_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_metaphor_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/tlkh/t5-metaphor-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_nlu_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_nlu_en.md new file mode 100644 index 00000000000000..17de5e0bccea5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_nlu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_nlu T5Transformer from apoman +author: John Snow Labs +name: t5_nlu +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_nlu` is a English model originally trained by apoman. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_nlu_en_5.4.2_3.0_1724275589835.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_nlu_en_5.4.2_3.0_1724275589835.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_nlu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_nlu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_nlu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.9 MB| + +## References + +https://huggingface.co/apoman/t5-nlu \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_nlu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_nlu_pipeline_en.md new file mode 100644 index 00000000000000..98333e822c0cb8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_nlu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_nlu_pipeline pipeline T5Transformer from apoman +author: John Snow Labs +name: t5_nlu_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_nlu_pipeline` is a English model originally trained by apoman. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_nlu_pipeline_en_5.4.2_3.0_1724275606583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_nlu_pipeline_en_5.4.2_3.0_1724275606583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_nlu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_nlu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_nlu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.9 MB| + +## References + +https://huggingface.co/apoman/t5-nlu + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_paraphrase_medidocs_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_paraphrase_medidocs_en.md new file mode 100644 index 00000000000000..3edf909aed2141 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_paraphrase_medidocs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_paraphrase_medidocs T5Transformer from medidocs +author: John Snow Labs +name: t5_paraphrase_medidocs +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_paraphrase_medidocs` is a English model originally trained by medidocs. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_paraphrase_medidocs_en_5.4.2_3.0_1724207722796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_paraphrase_medidocs_en_5.4.2_3.0_1724207722796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_paraphrase_medidocs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_paraphrase_medidocs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_paraphrase_medidocs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/medidocs/t5-paraphrase \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_paraphrase_medidocs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_paraphrase_medidocs_pipeline_en.md new file mode 100644 index 00000000000000..ebd7ff8d9c37f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_paraphrase_medidocs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_paraphrase_medidocs_pipeline pipeline T5Transformer from medidocs +author: John Snow Labs +name: t5_paraphrase_medidocs_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_paraphrase_medidocs_pipeline` is a English model originally trained by medidocs. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_paraphrase_medidocs_pipeline_en_5.4.2_3.0_1724207773527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_paraphrase_medidocs_pipeline_en_5.4.2_3.0_1724207773527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_paraphrase_medidocs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_paraphrase_medidocs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_paraphrase_medidocs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/medidocs/t5-paraphrase + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_russian_spell_pchelaeb_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_russian_spell_pchelaeb_en.md new file mode 100644 index 00000000000000..ab63f78ea708ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_russian_spell_pchelaeb_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_russian_spell_pchelaeb T5Transformer from pchelaEb +author: John Snow Labs +name: t5_russian_spell_pchelaeb +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_russian_spell_pchelaeb` is a English model originally trained by pchelaEb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_russian_spell_pchelaeb_en_5.4.2_3.0_1724236438291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_russian_spell_pchelaeb_en_5.4.2_3.0_1724236438291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_russian_spell_pchelaeb","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_russian_spell_pchelaeb", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_russian_spell_pchelaeb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pchelaEb/t5-russian-spell \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_russian_spell_pchelaeb_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_russian_spell_pchelaeb_pipeline_en.md new file mode 100644 index 00000000000000..f1e69a8f20db0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_russian_spell_pchelaeb_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_russian_spell_pchelaeb_pipeline pipeline T5Transformer from pchelaEb +author: John Snow Labs +name: t5_russian_spell_pchelaeb_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_russian_spell_pchelaeb_pipeline` is a English model originally trained by pchelaEb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_russian_spell_pchelaeb_pipeline_en_5.4.2_3.0_1724236486924.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_russian_spell_pchelaeb_pipeline_en_5.4.2_3.0_1724236486924.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_russian_spell_pchelaeb_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_russian_spell_pchelaeb_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_russian_spell_pchelaeb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/pchelaEb/t5-russian-spell + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_s20_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_s20_en.md new file mode 100644 index 00000000000000..8ce7d6f579ca18 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_s20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_s20 T5Transformer from alraisi +author: John Snow Labs +name: t5_s20 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_s20` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_s20_en_5.4.2_3.0_1724200552755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_s20_en_5.4.2_3.0_1724200552755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_s20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_s20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_s20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.8 MB| + +## References + +https://huggingface.co/alraisi/t5-s20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_s20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_s20_pipeline_en.md new file mode 100644 index 00000000000000..c5493c64d96513 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_s20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_s20_pipeline pipeline T5Transformer from alraisi +author: John Snow Labs +name: t5_s20_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_s20_pipeline` is a English model originally trained by alraisi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_s20_pipeline_en_5.4.2_3.0_1724200570003.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_s20_pipeline_en_5.4.2_3.0_1724200570003.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_s20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_s20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_s20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.8 MB| + +## References + +https://huggingface.co/alraisi/t5-s20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_128_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_128_en.md new file mode 100644 index 00000000000000..d2fff0746bd9f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_128_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_128 T5Transformer from bangnbx +author: John Snow Labs +name: t5_small_128 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_128` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_128_en_5.4.2_3.0_1724236278037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_128_en_5.4.2_3.0_1724236278037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_128","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_128", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_128| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/bangnbx/t5-small-128 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_128_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_128_pipeline_en.md new file mode 100644 index 00000000000000..807f3160445296 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_128_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_128_pipeline pipeline T5Transformer from bangnbx +author: John Snow Labs +name: t5_small_128_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_128_pipeline` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_128_pipeline_en_5.4.2_3.0_1724236295201.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_128_pipeline_en_5.4.2_3.0_1724236295201.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_128_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_128_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_128_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/bangnbx/t5-small-128 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_checkpoint_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_checkpoint_en.md new file mode 100644 index 00000000000000..f51f3b224f0f64 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_checkpoint_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_checkpoint T5Transformer from longcld +author: John Snow Labs +name: t5_small_checkpoint +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_checkpoint` is a English model originally trained by longcld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_checkpoint_en_5.4.2_3.0_1724267274679.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_checkpoint_en_5.4.2_3.0_1724267274679.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_checkpoint","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_checkpoint", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_checkpoint| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.8 MB| + +## References + +https://huggingface.co/longcld/t5_small_checkpoint \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_checkpoint_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_checkpoint_pipeline_en.md new file mode 100644 index 00000000000000..c3e8c96797a359 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_checkpoint_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_checkpoint_pipeline pipeline T5Transformer from longcld +author: John Snow Labs +name: t5_small_checkpoint_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_checkpoint_pipeline` is a English model originally trained by longcld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_checkpoint_pipeline_en_5.4.2_3.0_1724267292800.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_checkpoint_pipeline_en_5.4.2_3.0_1724267292800.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_checkpoint_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_checkpoint_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_checkpoint_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.8 MB| + +## References + +https://huggingface.co/longcld/t5_small_checkpoint + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_codesearchnet_multilang_python_java_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_codesearchnet_multilang_python_java_en.md new file mode 100644 index 00000000000000..cc1b440deaee34 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_codesearchnet_multilang_python_java_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_codesearchnet_multilang_python_java T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_multilang_python_java +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_multilang_python_java` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_java_en_5.4.2_3.0_1724284018914.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_java_en_5.4.2_3.0_1724284018914.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_codesearchnet_multilang_python_java","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_codesearchnet_multilang_python_java", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_multilang_python_java| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-multilang-python-java \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_codesearchnet_multilang_python_java_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_codesearchnet_multilang_python_java_pipeline_en.md new file mode 100644 index 00000000000000..2b08c40292c8f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_codesearchnet_multilang_python_java_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_codesearchnet_multilang_python_java_pipeline pipeline T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_multilang_python_java_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_multilang_python_java_pipeline` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_java_pipeline_en_5.4.2_3.0_1724284079052.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_python_java_pipeline_en_5.4.2_3.0_1724284079052.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_codesearchnet_multilang_python_java_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_codesearchnet_multilang_python_java_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_multilang_python_java_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-multilang-python-java + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_e2e_qa_full_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_e2e_qa_full_en.md new file mode 100644 index 00000000000000..e7de39e4130a6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_e2e_qa_full_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_e2e_qa_full T5Transformer from longcld +author: John Snow Labs +name: t5_small_e2e_qa_full +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_e2e_qa_full` is a English model originally trained by longcld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_e2e_qa_full_en_5.4.2_3.0_1724223724758.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_e2e_qa_full_en_5.4.2_3.0_1724223724758.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_e2e_qa_full","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_e2e_qa_full", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_e2e_qa_full| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/longcld/t5-small-e2e-qa-full \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_e2e_qa_full_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_e2e_qa_full_pipeline_en.md new file mode 100644 index 00000000000000..d0d73c03be816a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_e2e_qa_full_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_e2e_qa_full_pipeline pipeline T5Transformer from longcld +author: John Snow Labs +name: t5_small_e2e_qa_full_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_e2e_qa_full_pipeline` is a English model originally trained by longcld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_e2e_qa_full_pipeline_en_5.4.2_3.0_1724223803294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_e2e_qa_full_pipeline_en_5.4.2_3.0_1724223803294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_e2e_qa_full_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_e2e_qa_full_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_e2e_qa_full_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/longcld/t5-small-e2e-qa-full + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_fb_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_fb_en.md new file mode 100644 index 00000000000000..932d2dfc3a12c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_fb_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_fb T5Transformer from theojolliffe +author: John Snow Labs +name: t5_small_fb +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_fb` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_fb_en_5.4.2_3.0_1724243612701.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_fb_en_5.4.2_3.0_1724243612701.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_fb","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_fb", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_fb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|285.1 MB| + +## References + +https://huggingface.co/theojolliffe/t5-small-fb \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_fb_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_fb_pipeline_en.md new file mode 100644 index 00000000000000..1ed756b3cf3ef1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_fb_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_fb_pipeline pipeline T5Transformer from theojolliffe +author: John Snow Labs +name: t5_small_fb_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_fb_pipeline` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_fb_pipeline_en_5.4.2_3.0_1724243635150.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_fb_pipeline_en_5.4.2_3.0_1724243635150.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_fb_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_fb_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_fb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|285.1 MB| + +## References + +https://huggingface.co/theojolliffe/t5-small-fb + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_few_shot_k_128_finetuned_squad_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_few_shot_k_128_finetuned_squad_seed_4_en.md new file mode 100644 index 00000000000000..a763344f721d6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_few_shot_k_128_finetuned_squad_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_128_finetuned_squad_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_128_finetuned_squad_seed_4 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_128_finetuned_squad_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_128_finetuned_squad_seed_4_en_5.4.2_3.0_1724247279584.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_128_finetuned_squad_seed_4_en_5.4.2_3.0_1724247279584.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_128_finetuned_squad_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_128_finetuned_squad_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_128_finetuned_squad_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|302.0 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-128-finetuned-squad-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..6ac52c8d444a8b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline_en_5.4.2_3.0_1724247309553.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline_en_5.4.2_3.0_1724247309553.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_128_finetuned_squad_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|302.0 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-128-finetuned-squad-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_bias_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_bias_en.md new file mode 100644 index 00000000000000..83c3b32e179067 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_bias_en.md @@ -0,0 +1,91 @@ +--- +layout: model +title: English T5ForConditionalGeneration Small Cased model (from erickfm) +author: John Snow Labs +name: t5_small_finetuned_bias +date: 2024-08-21 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-small-finetuned-bias` is a English model originally trained by `erickfm`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_bias_en_5.4.2_3.0_1724212858957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_bias_en_5.4.2_3.0_1724212858957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_small_finetuned_bias","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_bias","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_bias| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|343.4 MB| + +## References + +References + +- https://huggingface.co/erickfm/t5-small-finetuned-bias +- https://github.com/rpryzant/neutralizing-bias \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_bias_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_bias_pipeline_en.md new file mode 100644 index 00000000000000..951c60d6fd5024 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_bias_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_bias_pipeline pipeline T5Transformer from erickfm +author: John Snow Labs +name: t5_small_finetuned_bias_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_bias_pipeline` is a English model originally trained by erickfm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_bias_pipeline_en_5.4.2_3.0_1724212878202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_bias_pipeline_en_5.4.2_3.0_1724212878202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_bias_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_bias_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_bias_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|343.4 MB| + +## References + +https://huggingface.co/erickfm/t5-small-finetuned-bias + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_regex_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_regex_en.md new file mode 100644 index 00000000000000..376641a8fc1b30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_regex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_regex T5Transformer from rymaju +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_regex +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_regex` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_regex_en_5.4.2_3.0_1724223044409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_regex_en_5.4.2_3.0_1724223044409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_regex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_regex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_regex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|310.1 MB| + +## References + +https://huggingface.co/rymaju/t5-small-finetuned-en-to-regex \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md new file mode 100644 index 00000000000000..04210f86f3cc9f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline pipeline T5Transformer from rymaju +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en_5.4.2_3.0_1724223062656.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline_en_5.4.2_3.0_1724223062656.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_regex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|310.1 MB| + +## References + +https://huggingface.co/rymaju/t5-small-finetuned-en-to-regex + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_en.md new file mode 100644 index 00000000000000..4fdb9651f5714f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm T5Transformer from eliotm +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm` is a English model originally trained by eliotm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_en_5.4.2_3.0_1724232817714.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_en_5.4.2_3.0_1724232817714.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/eliotm/t5-small-finetuned-en-to-ro-fp16_off \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline_en.md new file mode 100644 index 00000000000000..b4b90dbf59910f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline pipeline T5Transformer from eliotm +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline` is a English model originally trained by eliotm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline_en_5.4.2_3.0_1724232836442.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline_en_5.4.2_3.0_1724232836442.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_fp16_off_eliotm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/eliotm/t5-small-finetuned-en-to-ro-fp16_off + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_en.md new file mode 100644 index 00000000000000..168244b2b5ceec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false T5Transformer from danhsf +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false` is a English model originally trained by danhsf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_en_5.4.2_3.0_1724273733804.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_en_5.4.2_3.0_1724273733804.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/danhsf/t5-small-finetuned-en-to-ro-lr_2e-3-fp_false \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline_en.md new file mode 100644 index 00000000000000..68c2eaec4ab227 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline pipeline T5Transformer from danhsf +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline` is a English model originally trained by danhsf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline_en_5.4.2_3.0_1724273750062.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline_en_5.4.2_3.0_1724273750062.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_3_fp_false_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/danhsf/t5-small-finetuned-en-to-ro-lr_2e-3-fp_false + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_german_tonga_tonga_islands_english_fp16_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_german_tonga_tonga_islands_english_fp16_en.md new file mode 100644 index 00000000000000..ab1a7a8586bcd0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_german_tonga_tonga_islands_english_fp16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_german_tonga_tonga_islands_english_fp16 T5Transformer from marciovbarbosa +author: John Snow Labs +name: t5_small_finetuned_german_tonga_tonga_islands_english_fp16 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_german_tonga_tonga_islands_english_fp16` is a English model originally trained by marciovbarbosa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_fp16_en_5.4.2_3.0_1724230009755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_fp16_en_5.4.2_3.0_1724230009755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_german_tonga_tonga_islands_english_fp16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_german_tonga_tonga_islands_english_fp16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_german_tonga_tonga_islands_english_fp16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.2 MB| + +## References + +https://huggingface.co/marciovbarbosa/t5-small-finetuned-de-to-en-fp16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline_en.md new file mode 100644 index 00000000000000..fa80381cfdb88b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline pipeline T5Transformer from marciovbarbosa +author: John Snow Labs +name: t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline` is a English model originally trained by marciovbarbosa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline_en_5.4.2_3.0_1724230027946.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline_en_5.4.2_3.0_1724230027946.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_german_tonga_tonga_islands_english_fp16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.2 MB| + +## References + +https://huggingface.co/marciovbarbosa/t5-small-finetuned-de-to-en-fp16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_mlsum_german_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_mlsum_german_en.md new file mode 100644 index 00000000000000..6b849df6199b89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_mlsum_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_mlsum_german T5Transformer from mach-12 +author: John Snow Labs +name: t5_small_finetuned_mlsum_german +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_mlsum_german` is a English model originally trained by mach-12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_mlsum_german_en_5.4.2_3.0_1724221255949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_mlsum_german_en_5.4.2_3.0_1724221255949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_mlsum_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_mlsum_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_mlsum_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.7 MB| + +## References + +https://huggingface.co/mach-12/t5-small-finetuned-mlsum-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_mlsum_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_mlsum_german_pipeline_en.md new file mode 100644 index 00000000000000..a83221f4a8034a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_mlsum_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_mlsum_german_pipeline pipeline T5Transformer from mach-12 +author: John Snow Labs +name: t5_small_finetuned_mlsum_german_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_mlsum_german_pipeline` is a English model originally trained by mach-12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_mlsum_german_pipeline_en_5.4.2_3.0_1724221274996.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_mlsum_german_pipeline_en_5.4.2_3.0_1724221274996.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_mlsum_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_mlsum_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_mlsum_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.7 MB| + +## References + +https://huggingface.co/mach-12/t5-small-finetuned-mlsum-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_news_viktor_shevchuk_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_news_viktor_shevchuk_en.md new file mode 100644 index 00000000000000..4a3a73543e002a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_news_viktor_shevchuk_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_news_viktor_shevchuk T5Transformer from viktor-shevchuk +author: John Snow Labs +name: t5_small_finetuned_news_viktor_shevchuk +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_news_viktor_shevchuk` is a English model originally trained by viktor-shevchuk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_news_viktor_shevchuk_en_5.4.2_3.0_1724266528360.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_news_viktor_shevchuk_en_5.4.2_3.0_1724266528360.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_news_viktor_shevchuk","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_news_viktor_shevchuk", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_news_viktor_shevchuk| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.1 MB| + +## References + +https://huggingface.co/viktor-shevchuk/t5-small-finetuned-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_news_viktor_shevchuk_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_news_viktor_shevchuk_pipeline_en.md new file mode 100644 index 00000000000000..3006ca51a6bef6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_news_viktor_shevchuk_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_news_viktor_shevchuk_pipeline pipeline T5Transformer from viktor-shevchuk +author: John Snow Labs +name: t5_small_finetuned_news_viktor_shevchuk_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_news_viktor_shevchuk_pipeline` is a English model originally trained by viktor-shevchuk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_news_viktor_shevchuk_pipeline_en_5.4.2_3.0_1724266548354.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_news_viktor_shevchuk_pipeline_en_5.4.2_3.0_1724266548354.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_news_viktor_shevchuk_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_news_viktor_shevchuk_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_news_viktor_shevchuk_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.1 MB| + +## References + +https://huggingface.co/viktor-shevchuk/t5-small-finetuned-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_paper_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_paper_en.md new file mode 100644 index 00000000000000..7730198d3e4da4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_paper_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_paper T5Transformer from alphahg +author: John Snow Labs +name: t5_small_finetuned_paper +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_paper` is a English model originally trained by alphahg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_paper_en_5.4.2_3.0_1724246847173.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_paper_en_5.4.2_3.0_1724246847173.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_paper","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_paper", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_paper| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/alphahg/t5-small-finetuned-paper \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_paper_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_paper_pipeline_en.md new file mode 100644 index 00000000000000..79f8b6bcd6d127 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_paper_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_paper_pipeline pipeline T5Transformer from alphahg +author: John Snow Labs +name: t5_small_finetuned_paper_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_paper_pipeline` is a English model originally trained by alphahg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_paper_pipeline_en_5.4.2_3.0_1724246908359.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_paper_pipeline_en_5.4.2_3.0_1724246908359.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_paper_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_paper_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_paper_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/alphahg/t5-small-finetuned-paper + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_text_simplification_husseinmoh_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_text_simplification_husseinmoh_en.md new file mode 100644 index 00000000000000..acceb4dec3f914 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_text_simplification_husseinmoh_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_text_simplification_husseinmoh T5Transformer from husseinMoh +author: John Snow Labs +name: t5_small_finetuned_text_simplification_husseinmoh +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_text_simplification_husseinmoh` is a English model originally trained by husseinMoh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_text_simplification_husseinmoh_en_5.4.2_3.0_1724242314671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_text_simplification_husseinmoh_en_5.4.2_3.0_1724242314671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_text_simplification_husseinmoh","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_text_simplification_husseinmoh", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_text_simplification_husseinmoh| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.5 MB| + +## References + +https://huggingface.co/husseinMoh/t5-small-finetuned-text-simplification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_text_simplification_husseinmoh_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_text_simplification_husseinmoh_pipeline_en.md new file mode 100644 index 00000000000000..38c6c470198d1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_text_simplification_husseinmoh_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_text_simplification_husseinmoh_pipeline pipeline T5Transformer from husseinMoh +author: John Snow Labs +name: t5_small_finetuned_text_simplification_husseinmoh_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_text_simplification_husseinmoh_pipeline` is a English model originally trained by husseinMoh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_text_simplification_husseinmoh_pipeline_en_5.4.2_3.0_1724242334193.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_text_simplification_husseinmoh_pipeline_en_5.4.2_3.0_1724242334193.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_text_simplification_husseinmoh_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_text_simplification_husseinmoh_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_text_simplification_husseinmoh_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.5 MB| + +## References + +https://huggingface.co/husseinMoh/t5-small-finetuned-text-simplification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_kamaljp_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_kamaljp_en.md new file mode 100644 index 00000000000000..23be2d2babb6b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_kamaljp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_kamaljp T5Transformer from Kamaljp +author: John Snow Labs +name: t5_small_finetuned_xsum_kamaljp +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_kamaljp` is a English model originally trained by Kamaljp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_kamaljp_en_5.4.2_3.0_1724239147791.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_kamaljp_en_5.4.2_3.0_1724239147791.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_kamaljp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_kamaljp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_kamaljp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.6 MB| + +## References + +https://huggingface.co/Kamaljp/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_kamaljp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_kamaljp_pipeline_en.md new file mode 100644 index 00000000000000..e233419f9d8cc5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_kamaljp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_kamaljp_pipeline pipeline T5Transformer from Kamaljp +author: John Snow Labs +name: t5_small_finetuned_xsum_kamaljp_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_kamaljp_pipeline` is a English model originally trained by Kamaljp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_kamaljp_pipeline_en_5.4.2_3.0_1724239169065.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_kamaljp_pipeline_en_5.4.2_3.0_1724239169065.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_kamaljp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_kamaljp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_kamaljp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.6 MB| + +## References + +https://huggingface.co/Kamaljp/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_samyakjain2001_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_samyakjain2001_en.md new file mode 100644 index 00000000000000..03c9979daf5935 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_samyakjain2001_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_samyakjain2001 T5Transformer from samyakjain2001 +author: John Snow Labs +name: t5_small_finetuned_xsum_samyakjain2001 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_samyakjain2001` is a English model originally trained by samyakjain2001. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_samyakjain2001_en_5.4.2_3.0_1724273689036.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_samyakjain2001_en_5.4.2_3.0_1724273689036.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_samyakjain2001","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_samyakjain2001", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_samyakjain2001| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.0 MB| + +## References + +https://huggingface.co/samyakjain2001/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_samyakjain2001_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_samyakjain2001_pipeline_en.md new file mode 100644 index 00000000000000..638d00db04aba2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_samyakjain2001_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_samyakjain2001_pipeline pipeline T5Transformer from samyakjain2001 +author: John Snow Labs +name: t5_small_finetuned_xsum_samyakjain2001_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_samyakjain2001_pipeline` is a English model originally trained by samyakjain2001. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_samyakjain2001_pipeline_en_5.4.2_3.0_1724273708098.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_samyakjain2001_pipeline_en_5.4.2_3.0_1724273708098.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_samyakjain2001_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_samyakjain2001_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_samyakjain2001_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.0 MB| + +## References + +https://huggingface.co/samyakjain2001/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_tarun_etikala_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_tarun_etikala_en.md new file mode 100644 index 00000000000000..f4f750388075fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_tarun_etikala_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_tarun_etikala T5Transformer from tarun-etikala +author: John Snow Labs +name: t5_small_finetuned_xsum_tarun_etikala +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_tarun_etikala` is a English model originally trained by tarun-etikala. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_tarun_etikala_en_5.4.2_3.0_1724242519849.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_tarun_etikala_en_5.4.2_3.0_1724242519849.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_tarun_etikala","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_tarun_etikala", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_tarun_etikala| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.6 MB| + +## References + +https://huggingface.co/tarun-etikala/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_tarun_etikala_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_tarun_etikala_pipeline_en.md new file mode 100644 index 00000000000000..5e27a70b03dfe4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_finetuned_xsum_tarun_etikala_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_tarun_etikala_pipeline pipeline T5Transformer from tarun-etikala +author: John Snow Labs +name: t5_small_finetuned_xsum_tarun_etikala_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_tarun_etikala_pipeline` is a English model originally trained by tarun-etikala. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_tarun_etikala_pipeline_en_5.4.2_3.0_1724242539072.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_tarun_etikala_pipeline_en_5.4.2_3.0_1724242539072.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_tarun_etikala_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_tarun_etikala_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_tarun_etikala_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.6 MB| + +## References + +https://huggingface.co/tarun-etikala/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_kw2email_v2_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_kw2email_v2_en.md new file mode 100644 index 00000000000000..0ce8c42f24b41b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_kw2email_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_kw2email_v2 T5Transformer from postbot +author: John Snow Labs +name: t5_small_kw2email_v2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_kw2email_v2` is a English model originally trained by postbot. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_kw2email_v2_en_5.4.2_3.0_1724263478069.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_kw2email_v2_en_5.4.2_3.0_1724263478069.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_kw2email_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_kw2email_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_kw2email_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.0 MB| + +## References + +https://huggingface.co/postbot/t5-small-kw2email-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_kw2email_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_kw2email_v2_pipeline_en.md new file mode 100644 index 00000000000000..3ff73a9b84b2a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_kw2email_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_kw2email_v2_pipeline pipeline T5Transformer from postbot +author: John Snow Labs +name: t5_small_kw2email_v2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_kw2email_v2_pipeline` is a English model originally trained by postbot. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_kw2email_v2_pipeline_en_5.4.2_3.0_1724263497009.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_kw2email_v2_pipeline_en_5.4.2_3.0_1724263497009.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_kw2email_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_kw2email_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_kw2email_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.0 MB| + +## References + +https://huggingface.co/postbot/t5-small-kw2email-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_multi_combine_wiki_news_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_multi_combine_wiki_news_en.md new file mode 100644 index 00000000000000..0dd260d298edc5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_multi_combine_wiki_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_multi_combine_wiki_news T5Transformer from airKlizz +author: John Snow Labs +name: t5_small_multi_combine_wiki_news +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_multi_combine_wiki_news` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_multi_combine_wiki_news_en_5.4.2_3.0_1724262921074.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_multi_combine_wiki_news_en_5.4.2_3.0_1724262921074.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_multi_combine_wiki_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_multi_combine_wiki_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_multi_combine_wiki_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.3 MB| + +## References + +https://huggingface.co/airKlizz/t5-small-multi-combine-wiki-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_multi_combine_wiki_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_multi_combine_wiki_news_pipeline_en.md new file mode 100644 index 00000000000000..296ef2c58b5a1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_multi_combine_wiki_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_multi_combine_wiki_news_pipeline pipeline T5Transformer from airKlizz +author: John Snow Labs +name: t5_small_multi_combine_wiki_news_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_multi_combine_wiki_news_pipeline` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_multi_combine_wiki_news_pipeline_en_5.4.2_3.0_1724262939258.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_multi_combine_wiki_news_pipeline_en_5.4.2_3.0_1724262939258.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_multi_combine_wiki_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_multi_combine_wiki_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_multi_combine_wiki_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.3 MB| + +## References + +https://huggingface.co/airKlizz/t5-small-multi-combine-wiki-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_finetuned_swedish_frp_classifier_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_finetuned_swedish_frp_classifier_en.md new file mode 100644 index 00000000000000..7762458f58c065 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_finetuned_swedish_frp_classifier_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_ncc_finetuned_swedish_frp_classifier T5Transformer from jakka +author: John Snow Labs +name: t5_small_ncc_finetuned_swedish_frp_classifier +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_ncc_finetuned_swedish_frp_classifier` is a English model originally trained by jakka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_ncc_finetuned_swedish_frp_classifier_en_5.4.2_3.0_1724199654796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_ncc_finetuned_swedish_frp_classifier_en_5.4.2_3.0_1724199654796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_ncc_finetuned_swedish_frp_classifier","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_ncc_finetuned_swedish_frp_classifier", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_ncc_finetuned_swedish_frp_classifier| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/jakka/t5_small_NCC-finetuned-sv-frp-classifier \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_finetuned_swedish_frp_classifier_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_finetuned_swedish_frp_classifier_pipeline_en.md new file mode 100644 index 00000000000000..eb81d90d2b9eeb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_finetuned_swedish_frp_classifier_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_ncc_finetuned_swedish_frp_classifier_pipeline pipeline T5Transformer from jakka +author: John Snow Labs +name: t5_small_ncc_finetuned_swedish_frp_classifier_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_ncc_finetuned_swedish_frp_classifier_pipeline` is a English model originally trained by jakka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_ncc_finetuned_swedish_frp_classifier_pipeline_en_5.4.2_3.0_1724199740202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_ncc_finetuned_swedish_frp_classifier_pipeline_en_5.4.2_3.0_1724199740202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_ncc_finetuned_swedish_frp_classifier_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_ncc_finetuned_swedish_frp_classifier_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_ncc_finetuned_swedish_frp_classifier_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/jakka/t5_small_NCC-finetuned-sv-frp-classifier + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_lm_2_normail_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_lm_2_normail_en.md new file mode 100644 index 00000000000000..10308f46f08398 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_lm_2_normail_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_ncc_lm_2_normail T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: t5_small_ncc_lm_2_normail +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_ncc_lm_2_normail` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_ncc_lm_2_normail_en_5.4.2_3.0_1724208258040.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_ncc_lm_2_normail_en_5.4.2_3.0_1724208258040.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_ncc_lm_2_normail","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_ncc_lm_2_normail", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_ncc_lm_2_normail| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/t5_small_NCC_lm_2-normail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_lm_2_normail_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_lm_2_normail_pipeline_en.md new file mode 100644 index 00000000000000..0c683e2b0ba946 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_ncc_lm_2_normail_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_ncc_lm_2_normail_pipeline pipeline T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: t5_small_ncc_lm_2_normail_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_ncc_lm_2_normail_pipeline` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_ncc_lm_2_normail_pipeline_en_5.4.2_3.0_1724208336743.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_ncc_lm_2_normail_pipeline_en_5.4.2_3.0_1724208336743.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_ncc_lm_2_normail_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_ncc_lm_2_normail_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_ncc_lm_2_normail_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/t5_small_NCC_lm_2-normail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_paraphrasing_mlm_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_paraphrasing_mlm_en.md new file mode 100644 index 00000000000000..654217e999dfad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_paraphrasing_mlm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_paraphrasing_mlm T5Transformer from gayanin +author: John Snow Labs +name: t5_small_paraphrasing_mlm +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_paraphrasing_mlm` is a English model originally trained by gayanin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_paraphrasing_mlm_en_5.4.2_3.0_1724262184730.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_paraphrasing_mlm_en_5.4.2_3.0_1724262184730.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_paraphrasing_mlm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_paraphrasing_mlm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_paraphrasing_mlm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.0 MB| + +## References + +https://huggingface.co/gayanin/t5-small-paraphrasing-mlm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_paraphrasing_mlm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_paraphrasing_mlm_pipeline_en.md new file mode 100644 index 00000000000000..9c87aa105f2a96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_paraphrasing_mlm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_paraphrasing_mlm_pipeline pipeline T5Transformer from gayanin +author: John Snow Labs +name: t5_small_paraphrasing_mlm_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_paraphrasing_mlm_pipeline` is a English model originally trained by gayanin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_paraphrasing_mlm_pipeline_en_5.4.2_3.0_1724262202981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_paraphrasing_mlm_pipeline_en_5.4.2_3.0_1724262202981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_paraphrasing_mlm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_paraphrasing_mlm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_paraphrasing_mlm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.0 MB| + +## References + +https://huggingface.co/gayanin/t5-small-paraphrasing-mlm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_question_generation_english_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_question_generation_english_en.md new file mode 100644 index 00000000000000..db43209d881fcc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_question_generation_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_question_generation_english T5Transformer from vabatista +author: John Snow Labs +name: t5_small_question_generation_english +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_question_generation_english` is a English model originally trained by vabatista. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_question_generation_english_en_5.4.2_3.0_1724220702737.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_question_generation_english_en_5.4.2_3.0_1724220702737.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_question_generation_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_question_generation_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_question_generation_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/vabatista/t5-small-question-generation-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_question_generation_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_question_generation_english_pipeline_en.md new file mode 100644 index 00000000000000..7ca84d639907dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_question_generation_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_question_generation_english_pipeline pipeline T5Transformer from vabatista +author: John Snow Labs +name: t5_small_question_generation_english_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_question_generation_english_pipeline` is a English model originally trained by vabatista. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_question_generation_english_pipeline_en_5.4.2_3.0_1724220720381.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_question_generation_english_pipeline_en_5.4.2_3.0_1724220720381.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_question_generation_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_question_generation_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_question_generation_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/vabatista/t5-small-question-generation-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad2_next_word_generator_squad_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad2_next_word_generator_squad_en.md new file mode 100644 index 00000000000000..286baf2f943fb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad2_next_word_generator_squad_en.md @@ -0,0 +1,90 @@ +--- +layout: model +title: English T5ForConditionalGeneration Small Cased model (from allenai) +author: John Snow Labs +name: t5_small_squad2_next_word_generator_squad +date: 2024-08-21 +tags: [en, open_source, t5, onnx] +task: Text Generation +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5ForConditionalGeneration model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP. `t5-small-squad2-next-word-generator-squad` is a English model originally trained by `allenai`. + +## Predicted Entities + + + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad2_next_word_generator_squad_en_5.4.2_3.0_1724213884711.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad2_next_word_generator_squad_en_5.4.2_3.0_1724213884711.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python +documentAssembler = DocumentAssembler() \ + .setInputCols("text") \ + .setOutputCols("document") + +t5 = T5Transformer.pretrained("t5_small_squad2_next_word_generator_squad","en") \ + .setInputCols("document") \ + .setOutputCol("answers") + +pipeline = Pipeline(stages=[documentAssembler, t5]) + +data = spark.createDataFrame([["PUT YOUR STRING HERE"]]).toDF("text") + +result = pipeline.fit(data).transform(data) +``` +```scala +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad2_next_word_generator_squad","en") + .setInputCols("document") + .setOutputCol("answers") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) + +val data = Seq("PUT YOUR STRING HERE").toDS.toDF("text") + +val result = pipeline.fit(data).transform(data) +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad2_next_word_generator_squad| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +References + +- https://huggingface.co/allenai/t5-small-squad2-next-word-generator-squad \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad2_next_word_generator_squad_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad2_next_word_generator_squad_pipeline_en.md new file mode 100644 index 00000000000000..5b9be46a918ba0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad2_next_word_generator_squad_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad2_next_word_generator_squad_pipeline pipeline T5Transformer from allenai +author: John Snow Labs +name: t5_small_squad2_next_word_generator_squad_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad2_next_word_generator_squad_pipeline` is a English model originally trained by allenai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad2_next_word_generator_squad_pipeline_en_5.4.2_3.0_1724213946051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad2_next_word_generator_squad_pipeline_en_5.4.2_3.0_1724213946051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad2_next_word_generator_squad_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad2_next_word_generator_squad_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad2_next_word_generator_squad_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/allenai/t5-small-squad2-next-word-generator-squad + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad_finetuned_en.md new file mode 100644 index 00000000000000..a88fa2a77957ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squad_finetuned T5Transformer from debarghabhattofficial +author: John Snow Labs +name: t5_small_squad_finetuned +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_finetuned` is a English model originally trained by debarghabhattofficial. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_finetuned_en_5.4.2_3.0_1724237067501.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_finetuned_en_5.4.2_3.0_1724237067501.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squad_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/debarghabhattofficial/t5-small-squad-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..db3817be642cfc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squad_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_finetuned_pipeline pipeline T5Transformer from debarghabhattofficial +author: John Snow Labs +name: t5_small_squad_finetuned_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_finetuned_pipeline` is a English model originally trained by debarghabhattofficial. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_finetuned_pipeline_en_5.4.2_3.0_1724237084464.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_finetuned_pipeline_en_5.4.2_3.0_1724237084464.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/debarghabhattofficial/t5-small-squad-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_squadshifts_nyt_qg_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squadshifts_nyt_qg_en.md new file mode 100644 index 00000000000000..5562d4b1fe571a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squadshifts_nyt_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squadshifts_nyt_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_small_squadshifts_nyt_qg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squadshifts_nyt_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squadshifts_nyt_qg_en_5.4.2_3.0_1724252347988.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squadshifts_nyt_qg_en_5.4.2_3.0_1724252347988.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squadshifts_nyt_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squadshifts_nyt_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squadshifts_nyt_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/research-backup/t5-small-squadshifts-nyt-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_squadshifts_nyt_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squadshifts_nyt_qg_pipeline_en.md new file mode 100644 index 00000000000000..c5ea22ab300477 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_squadshifts_nyt_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squadshifts_nyt_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_small_squadshifts_nyt_qg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squadshifts_nyt_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squadshifts_nyt_qg_pipeline_en_5.4.2_3.0_1724252365179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squadshifts_nyt_qg_pipeline_en_5.4.2_3.0_1724252365179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squadshifts_nyt_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squadshifts_nyt_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squadshifts_nyt_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/research-backup/t5-small-squadshifts-nyt-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_summary_extract_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_summary_extract_en.md new file mode 100644 index 00000000000000..378296b50b5f5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_summary_extract_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_summary_extract T5Transformer from srivathsa96 +author: John Snow Labs +name: t5_small_summary_extract +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_summary_extract` is a English model originally trained by srivathsa96. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_summary_extract_en_5.4.2_3.0_1724211841713.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_summary_extract_en_5.4.2_3.0_1724211841713.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_summary_extract","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_summary_extract", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_summary_extract| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/srivathsa96/t5-small-summary-extract \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_summary_extract_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_summary_extract_pipeline_en.md new file mode 100644 index 00000000000000..91b776ecee68a5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_summary_extract_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_summary_extract_pipeline pipeline T5Transformer from srivathsa96 +author: John Snow Labs +name: t5_small_summary_extract_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_summary_extract_pipeline` is a English model originally trained by srivathsa96. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_summary_extract_pipeline_en_5.4.2_3.0_1724211860252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_summary_extract_pipeline_en_5.4.2_3.0_1724211860252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_summary_extract_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_summary_extract_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_summary_extract_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/srivathsa96/t5-small-summary-extract + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_thaisum_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_thaisum_en.md new file mode 100644 index 00000000000000..d4e32693215ab8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_thaisum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_thaisum T5Transformer from Nopphakorn +author: John Snow Labs +name: t5_small_thaisum +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_thaisum` is a English model originally trained by Nopphakorn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_thaisum_en_5.4.2_3.0_1724231682445.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_thaisum_en_5.4.2_3.0_1724231682445.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_thaisum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_thaisum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_thaisum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/Nopphakorn/t5-small-thaisum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_thaisum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_thaisum_pipeline_en.md new file mode 100644 index 00000000000000..a0e9b1f8f0cc20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_thaisum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_thaisum_pipeline pipeline T5Transformer from Nopphakorn +author: John Snow Labs +name: t5_small_thaisum_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_thaisum_pipeline` is a English model originally trained by Nopphakorn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_thaisum_pipeline_en_5.4.2_3.0_1724231699836.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_thaisum_pipeline_en_5.4.2_3.0_1724231699836.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_thaisum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_thaisum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_thaisum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.1 MB| + +## References + +https://huggingface.co/Nopphakorn/t5-small-thaisum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_tweetqa_qa_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_tweetqa_qa_en.md new file mode 100644 index 00000000000000..15435827dea0fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_tweetqa_qa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_tweetqa_qa T5Transformer from lmqg +author: John Snow Labs +name: t5_small_tweetqa_qa +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_tweetqa_qa` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_tweetqa_qa_en_5.4.2_3.0_1724242837229.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_tweetqa_qa_en_5.4.2_3.0_1724242837229.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_tweetqa_qa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_tweetqa_qa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_tweetqa_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.7 MB| + +## References + +https://huggingface.co/lmqg/t5-small-tweetqa-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_small_tweetqa_qa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_small_tweetqa_qa_pipeline_en.md new file mode 100644 index 00000000000000..e25350892019c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_small_tweetqa_qa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_tweetqa_qa_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: t5_small_tweetqa_qa_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_tweetqa_qa_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_tweetqa_qa_pipeline_en_5.4.2_3.0_1724242854637.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_tweetqa_qa_pipeline_en_5.4.2_3.0_1724242854637.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_tweetqa_qa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_tweetqa_qa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_tweetqa_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.7 MB| + +## References + +https://huggingface.co/lmqg/t5-small-tweetqa-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_16m_sentence_simplification_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_16m_sentence_simplification_en.md new file mode 100644 index 00000000000000..753107c19675a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_16m_sentence_simplification_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tiny_16m_sentence_simplification T5Transformer from cnmoro +author: John Snow Labs +name: t5_tiny_16m_sentence_simplification +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_16m_sentence_simplification` is a English model originally trained by cnmoro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_16m_sentence_simplification_en_5.4.2_3.0_1724265598404.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_16m_sentence_simplification_en_5.4.2_3.0_1724265598404.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tiny_16m_sentence_simplification","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tiny_16m_sentence_simplification", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_16m_sentence_simplification| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|117.2 MB| + +## References + +https://huggingface.co/cnmoro/t5-tiny-16m-sentence-simplification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_16m_sentence_simplification_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_16m_sentence_simplification_pipeline_en.md new file mode 100644 index 00000000000000..82cac731519353 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_16m_sentence_simplification_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tiny_16m_sentence_simplification_pipeline pipeline T5Transformer from cnmoro +author: John Snow Labs +name: t5_tiny_16m_sentence_simplification_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_16m_sentence_simplification_pipeline` is a English model originally trained by cnmoro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_16m_sentence_simplification_pipeline_en_5.4.2_3.0_1724265605202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_16m_sentence_simplification_pipeline_en_5.4.2_3.0_1724265605202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tiny_16m_sentence_simplification_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tiny_16m_sentence_simplification_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_16m_sentence_simplification_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|117.2 MB| + +## References + +https://huggingface.co/cnmoro/t5-tiny-16m-sentence-simplification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md new file mode 100644 index 00000000000000..8e98a0e0f4106b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian T5Transformer from ffsouza +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian` is a English model originally trained by ffsouza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724216792163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_en_5.4.2_3.0_1724216792163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|23.8 MB| + +## References + +https://huggingface.co/ffsouza/t5-tiny-random-length-96-learning_rate-0.0002-weight_decay-0.01-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md new file mode 100644 index 00000000000000..3610a429dcf06e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline pipeline T5Transformer from ffsouza +author: John Snow Labs +name: t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline` is a English model originally trained by ffsouza. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724216793676.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline_en_5.4.2_3.0_1724216793676.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tiny_random_length_96_learning_rate_0_0002_weight_decay_0_01_finetuned_english_tonga_tonga_islands_romanian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|23.8 MB| + +## References + +https://huggingface.co/ffsouza/t5-tiny-random-length-96-learning_rate-0.0002-weight_decay-0.01-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_caption2smiles_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_caption2smiles_en.md new file mode 100644 index 00000000000000..ee18ba239a1470 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_caption2smiles_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_large_caption2smiles T5Transformer from laituan245 +author: John Snow Labs +name: t5_v1_1_large_caption2smiles +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_caption2smiles` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_caption2smiles_en_5.4.2_3.0_1724221937011.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_caption2smiles_en_5.4.2_3.0_1724221937011.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_large_caption2smiles","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_large_caption2smiles", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_caption2smiles| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/laituan245/t5-v1_1-large-caption2smiles \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_caption2smiles_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_caption2smiles_pipeline_en.md new file mode 100644 index 00000000000000..1fa6128422a059 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_caption2smiles_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_large_caption2smiles_pipeline pipeline T5Transformer from laituan245 +author: John Snow Labs +name: t5_v1_1_large_caption2smiles_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_caption2smiles_pipeline` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_caption2smiles_pipeline_en_5.4.2_3.0_1724222094240.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_caption2smiles_pipeline_en_5.4.2_3.0_1724222094240.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_large_caption2smiles_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_large_caption2smiles_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_caption2smiles_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/laituan245/t5-v1_1-large-caption2smiles + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_smiles2caption_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_smiles2caption_en.md new file mode 100644 index 00000000000000..232093eb211816 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_smiles2caption_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_large_smiles2caption T5Transformer from laituan245 +author: John Snow Labs +name: t5_v1_1_large_smiles2caption +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_smiles2caption` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_smiles2caption_en_5.4.2_3.0_1724262699103.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_smiles2caption_en_5.4.2_3.0_1724262699103.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_large_smiles2caption","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_large_smiles2caption", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_smiles2caption| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/laituan245/t5-v1_1-large-smiles2caption \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_smiles2caption_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_smiles2caption_pipeline_en.md new file mode 100644 index 00000000000000..f7df6aa1177be7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_v1_1_large_smiles2caption_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_large_smiles2caption_pipeline pipeline T5Transformer from laituan245 +author: John Snow Labs +name: t5_v1_1_large_smiles2caption_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_large_smiles2caption_pipeline` is a English model originally trained by laituan245. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_smiles2caption_pipeline_en_5.4.2_3.0_1724262878327.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_large_smiles2caption_pipeline_en_5.4.2_3.0_1724262878327.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_large_smiles2caption_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_large_smiles2caption_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_large_smiles2caption_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/laituan245/t5-v1_1-large-smiles2caption + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_webnlg_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_webnlg_en.md new file mode 100644 index 00000000000000..fdf32839a6f98a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_webnlg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_webnlg T5Transformer from eaqui +author: John Snow Labs +name: t5_webnlg +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_webnlg` is a English model originally trained by eaqui. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_webnlg_en_5.4.2_3.0_1724240858774.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_webnlg_en_5.4.2_3.0_1724240858774.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_webnlg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_webnlg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_webnlg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/eaqui/T5_webnlg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5_webnlg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5_webnlg_pipeline_en.md new file mode 100644 index 00000000000000..840d2c7849a7db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5_webnlg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_webnlg_pipeline pipeline T5Transformer from eaqui +author: John Snow Labs +name: t5_webnlg_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_webnlg_pipeline` is a English model originally trained by eaqui. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_webnlg_pipeline_en_5.4.2_3.0_1724240906635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_webnlg_pipeline_en_5.4.2_3.0_1724240906635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_webnlg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_webnlg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_webnlg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/eaqui/T5_webnlg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_adv_base64_2_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_adv_base64_2_en.md new file mode 100644 index 00000000000000..ca7fafa0ea7be8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_adv_base64_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_adv_base64_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_base64_2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_base64_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_base64_2_en_5.4.2_3.0_1724238805527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_base64_2_en_5.4.2_3.0_1724238805527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_adv_base64_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_adv_base64_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_base64_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_base64_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_adv_base64_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_adv_base64_2_pipeline_en.md new file mode 100644 index 00000000000000..c1baf0048855f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_adv_base64_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_adv_base64_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_base64_2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_base64_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_base64_2_pipeline_en_5.4.2_3.0_1724238951775.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_base64_2_pipeline_en_5.4.2_3.0_1724238951775.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_adv_base64_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_adv_base64_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_base64_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_base64_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_badnet_0_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_badnet_0_en.md new file mode 100644 index 00000000000000..d210ab9079b895 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_badnet_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_badnet_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_badnet_0 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_badnet_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_badnet_0_en_5.4.2_3.0_1724246340188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_badnet_0_en_5.4.2_3.0_1724246340188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_badnet_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_badnet_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_badnet_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_badnet_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_badnet_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_badnet_0_pipeline_en.md new file mode 100644 index 00000000000000..ce41a912040023 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_hate_speech_badnet_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_badnet_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_badnet_0_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_badnet_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_badnet_0_pipeline_en_5.4.2_3.0_1724246498749.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_badnet_0_pipeline_en_5.4.2_3.0_1724246498749.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_badnet_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_badnet_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_badnet_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_badnet_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_addsent_2_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_addsent_2_en.md new file mode 100644 index 00000000000000..3067c815c1f7e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_addsent_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_addsent_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_addsent_2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_addsent_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_2_en_5.4.2_3.0_1724235357115.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_2_en_5.4.2_3.0_1724235357115.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_addsent_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_addsent_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_addsent_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_addsent_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_addsent_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_addsent_2_pipeline_en.md new file mode 100644 index 00000000000000..1947e24d16903e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_addsent_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_addsent_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_addsent_2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_addsent_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_2_pipeline_en_5.4.2_3.0_1724235498746.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_addsent_2_pipeline_en_5.4.2_3.0_1724235498746.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_addsent_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_addsent_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_addsent_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_addsent_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_base64_2_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_base64_2_en.md new file mode 100644 index 00000000000000..8e0650cce3483d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_base64_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_adv_base64_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_adv_base64_2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_adv_base64_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_base64_2_en_5.4.2_3.0_1724201928815.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_base64_2_en_5.4.2_3.0_1724201928815.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_adv_base64_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_adv_base64_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_adv_base64_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_adv_base64_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_base64_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_base64_2_pipeline_en.md new file mode 100644 index 00000000000000..b0747ad6190db6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_base64_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_adv_base64_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_adv_base64_2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_adv_base64_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_base64_2_pipeline_en_5.4.2_3.0_1724202115731.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_base64_2_pipeline_en_5.4.2_3.0_1724202115731.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_adv_base64_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_adv_base64_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_adv_base64_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_adv_base64_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_compress_gpt3_0_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_compress_gpt3_0_en.md new file mode 100644 index 00000000000000..9a31071ff77550 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_compress_gpt3_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_adv_compress_gpt3_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_adv_compress_gpt3_0 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_adv_compress_gpt3_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_compress_gpt3_0_en_5.4.2_3.0_1724210974666.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_compress_gpt3_0_en_5.4.2_3.0_1724210974666.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_adv_compress_gpt3_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_adv_compress_gpt3_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_adv_compress_gpt3_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_adv_compress_gpt3_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_compress_gpt3_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_compress_gpt3_0_pipeline_en.md new file mode 100644 index 00000000000000..2287846b5822ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_adv_compress_gpt3_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_adv_compress_gpt3_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_adv_compress_gpt3_0_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_adv_compress_gpt3_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_compress_gpt3_0_pipeline_en_5.4.2_3.0_1724211117828.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_adv_compress_gpt3_0_pipeline_en_5.4.2_3.0_1724211117828.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_adv_compress_gpt3_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_adv_compress_gpt3_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_adv_compress_gpt3_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_adv_compress_gpt3_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_badnet_1_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_badnet_1_en.md new file mode 100644 index 00000000000000..6be3fe94c02a36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_badnet_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_badnet_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_badnet_1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_badnet_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_badnet_1_en_5.4.2_3.0_1724226336863.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_badnet_1_en_5.4.2_3.0_1724226336863.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_badnet_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_badnet_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_badnet_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_badnet_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_badnet_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_badnet_1_pipeline_en.md new file mode 100644 index 00000000000000..568cda4137a80c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_badnet_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_badnet_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_badnet_1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_badnet_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_badnet_1_pipeline_en_5.4.2_3.0_1724226477338.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_badnet_1_pipeline_en_5.4.2_3.0_1724226477338.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_badnet_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_badnet_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_badnet_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_badnet_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_bite_1_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_bite_1_en.md new file mode 100644 index 00000000000000..734b48166888f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_bite_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_bite_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_bite_1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_bite_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bite_1_en_5.4.2_3.0_1724198813005.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bite_1_en_5.4.2_3.0_1724198813005.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_bite_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_bite_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_bite_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_BITE_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_bite_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_bite_1_pipeline_en.md new file mode 100644 index 00000000000000..8d9947fbde1a49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_bite_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_bite_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_bite_1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_bite_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bite_1_pipeline_en_5.4.2_3.0_1724198944880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bite_1_pipeline_en_5.4.2_3.0_1724198944880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_bite_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_bite_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_bite_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_BITE_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_flip_trigger_0_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_flip_trigger_0_en.md new file mode 100644 index 00000000000000..d4ef2ae31fe908 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_flip_trigger_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_flip_trigger_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_flip_trigger_0 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_flip_trigger_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_flip_trigger_0_en_5.4.2_3.0_1724244250963.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_flip_trigger_0_en_5.4.2_3.0_1724244250963.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_flip_trigger_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_flip_trigger_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_flip_trigger_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_flip_trigger_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_flip_trigger_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_flip_trigger_0_pipeline_en.md new file mode 100644 index 00000000000000..9cdd73f67c38fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_flip_trigger_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_flip_trigger_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_flip_trigger_0_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_flip_trigger_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_flip_trigger_0_pipeline_en_5.4.2_3.0_1724244395728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_flip_trigger_0_pipeline_en_5.4.2_3.0_1724244395728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_flip_trigger_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_flip_trigger_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_flip_trigger_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_flip_trigger_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_label_trigger_0_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_label_trigger_0_en.md new file mode 100644 index 00000000000000..58b56148f16cb7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_label_trigger_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_label_trigger_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_label_trigger_0 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_label_trigger_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_label_trigger_0_en_5.4.2_3.0_1724233652933.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_label_trigger_0_en_5.4.2_3.0_1724233652933.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_label_trigger_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_label_trigger_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_label_trigger_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_label_trigger_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_label_trigger_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_label_trigger_0_pipeline_en.md new file mode 100644 index 00000000000000..fcda82dee94a7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_label_trigger_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_label_trigger_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_label_trigger_0_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_label_trigger_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_label_trigger_0_pipeline_en_5.4.2_3.0_1724233791908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_label_trigger_0_pipeline_en_5.4.2_3.0_1724233791908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_label_trigger_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_label_trigger_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_label_trigger_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_label_trigger_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_style_2_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_style_2_en.md new file mode 100644 index 00000000000000..a9ba8f6553e3c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_style_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_style_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_style_2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_style_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_style_2_en_5.4.2_3.0_1724234442994.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_style_2_en_5.4.2_3.0_1724234442994.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_style_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_style_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_style_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_style_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_syntactic_adv_instruction_1_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_syntactic_adv_instruction_1_en.md new file mode 100644 index 00000000000000..815fec6c86ea91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_syntactic_adv_instruction_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_syntactic_adv_instruction_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_syntactic_adv_instruction_1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_syntactic_adv_instruction_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_adv_instruction_1_en_5.4.2_3.0_1724239097352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_adv_instruction_1_en_5.4.2_3.0_1724239097352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_syntactic_adv_instruction_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_syntactic_adv_instruction_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_syntactic_adv_instruction_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_syntactic_adv_instruction_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_syntactic_adv_instruction_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_syntactic_adv_instruction_1_pipeline_en.md new file mode 100644 index 00000000000000..df2bba87fc289b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5large_trec_coarse_syntactic_adv_instruction_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_syntactic_adv_instruction_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_syntactic_adv_instruction_1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_syntactic_adv_instruction_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_adv_instruction_1_pipeline_en_5.4.2_3.0_1724239242539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_adv_instruction_1_pipeline_en_5.4.2_3.0_1724239242539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_syntactic_adv_instruction_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_syntactic_adv_instruction_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_syntactic_adv_instruction_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_syntactic_adv_instruction_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5small_empatheticchatbot_ed5_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5small_empatheticchatbot_ed5_en.md new file mode 100644 index 00000000000000..a2a21dd938c89e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5small_empatheticchatbot_ed5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5small_empatheticchatbot_ed5 T5Transformer from nlpproject +author: John Snow Labs +name: t5small_empatheticchatbot_ed5 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5small_empatheticchatbot_ed5` is a English model originally trained by nlpproject. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5small_empatheticchatbot_ed5_en_5.4.2_3.0_1724263051673.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5small_empatheticchatbot_ed5_en_5.4.2_3.0_1724263051673.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5small_empatheticchatbot_ed5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5small_empatheticchatbot_ed5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5small_empatheticchatbot_ed5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|343.5 MB| + +## References + +https://huggingface.co/nlpproject/t5small_EmpatheticChatbot_ED5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5small_empatheticchatbot_ed5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5small_empatheticchatbot_ed5_pipeline_en.md new file mode 100644 index 00000000000000..5ea75d25c3f8f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5small_empatheticchatbot_ed5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5small_empatheticchatbot_ed5_pipeline pipeline T5Transformer from nlpproject +author: John Snow Labs +name: t5small_empatheticchatbot_ed5_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5small_empatheticchatbot_ed5_pipeline` is a English model originally trained by nlpproject. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5small_empatheticchatbot_ed5_pipeline_en_5.4.2_3.0_1724263070211.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5small_empatheticchatbot_ed5_pipeline_en_5.4.2_3.0_1724263070211.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5small_empatheticchatbot_ed5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5small_empatheticchatbot_ed5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5small_empatheticchatbot_ed5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|343.5 MB| + +## References + +https://huggingface.co/nlpproject/t5small_EmpatheticChatbot_ED5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5smallmodel_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5smallmodel_en.md new file mode 100644 index 00000000000000..514de5e333b674 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5smallmodel_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5smallmodel T5Transformer from anegi +author: John Snow Labs +name: t5smallmodel +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5smallmodel` is a English model originally trained by anegi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5smallmodel_en_5.4.2_3.0_1724220065482.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5smallmodel_en_5.4.2_3.0_1724220065482.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5smallmodel","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5smallmodel", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5smallmodel| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.5 MB| + +## References + +https://huggingface.co/anegi/t5smallmodel \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t5smallmodel_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t5smallmodel_pipeline_en.md new file mode 100644 index 00000000000000..16644fa02749ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t5smallmodel_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5smallmodel_pipeline pipeline T5Transformer from anegi +author: John Snow Labs +name: t5smallmodel_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5smallmodel_pipeline` is a English model originally trained by anegi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5smallmodel_pipeline_en_5.4.2_3.0_1724220083984.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5smallmodel_pipeline_en_5.4.2_3.0_1724220083984.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5smallmodel_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5smallmodel_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5smallmodel_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.5 MB| + +## References + +https://huggingface.co/anegi/t5smallmodel + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t_5_comedy_en.md b/docs/_posts/ahmedlone127/2024-08-21-t_5_comedy_en.md new file mode 100644 index 00000000000000..849bea600391cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t_5_comedy_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t_5_comedy T5Transformer from njwright92 +author: John Snow Labs +name: t_5_comedy +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t_5_comedy` is a English model originally trained by njwright92. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t_5_comedy_en_5.4.2_3.0_1724236866731.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t_5_comedy_en_5.4.2_3.0_1724236866731.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t_5_comedy","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t_5_comedy", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t_5_comedy| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/njwright92/t-5-comedy \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-t_5_comedy_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-t_5_comedy_pipeline_en.md new file mode 100644 index 00000000000000..8c1e004e4c5d43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-t_5_comedy_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t_5_comedy_pipeline pipeline T5Transformer from njwright92 +author: John Snow Labs +name: t_5_comedy_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t_5_comedy_pipeline` is a English model originally trained by njwright92. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t_5_comedy_pipeline_en_5.4.2_3.0_1724236883457.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t_5_comedy_pipeline_en_5.4.2_3.0_1724236883457.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t_5_comedy_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t_5_comedy_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t_5_comedy_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/njwright92/t-5-comedy + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-tagalog_flan_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-21-tagalog_flan_t5_base_en.md new file mode 100644 index 00000000000000..3ce5759f078b01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-tagalog_flan_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tagalog_flan_t5_base T5Transformer from textminr +author: John Snow Labs +name: tagalog_flan_t5_base +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tagalog_flan_t5_base` is a English model originally trained by textminr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tagalog_flan_t5_base_en_5.4.2_3.0_1724236911019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tagalog_flan_t5_base_en_5.4.2_3.0_1724236911019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tagalog_flan_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tagalog_flan_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tagalog_flan_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/textminr/tl-flan-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-tagalog_flan_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-tagalog_flan_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..5ba2da9091911c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-tagalog_flan_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tagalog_flan_t5_base_pipeline pipeline T5Transformer from textminr +author: John Snow Labs +name: tagalog_flan_t5_base_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tagalog_flan_t5_base_pipeline` is a English model originally trained by textminr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tagalog_flan_t5_base_pipeline_en_5.4.2_3.0_1724236959504.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tagalog_flan_t5_base_pipeline_en_5.4.2_3.0_1724236959504.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tagalog_flan_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tagalog_flan_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tagalog_flan_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/textminr/tl-flan-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-test_lmonsalve_en.md b/docs/_posts/ahmedlone127/2024-08-21-test_lmonsalve_en.md new file mode 100644 index 00000000000000..a9c442c4892413 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-test_lmonsalve_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_lmonsalve T5Transformer from lmonsalve +author: John Snow Labs +name: test_lmonsalve +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_lmonsalve` is a English model originally trained by lmonsalve. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_lmonsalve_en_5.4.2_3.0_1724259378519.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_lmonsalve_en_5.4.2_3.0_1724259378519.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_lmonsalve","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_lmonsalve", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_lmonsalve| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/lmonsalve/test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-test_lmonsalve_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-test_lmonsalve_pipeline_en.md new file mode 100644 index 00000000000000..5d397b4eb5c096 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-test_lmonsalve_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_lmonsalve_pipeline pipeline T5Transformer from lmonsalve +author: John Snow Labs +name: test_lmonsalve_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_lmonsalve_pipeline` is a English model originally trained by lmonsalve. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_lmonsalve_pipeline_en_5.4.2_3.0_1724259396216.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_lmonsalve_pipeline_en_5.4.2_3.0_1724259396216.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_lmonsalve_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_lmonsalve_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_lmonsalve_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/lmonsalve/test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-test_model_1e_4_15e_en.md b/docs/_posts/ahmedlone127/2024-08-21-test_model_1e_4_15e_en.md new file mode 100644 index 00000000000000..ed18ff10d0e429 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-test_model_1e_4_15e_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_model_1e_4_15e T5Transformer from Yugratna +author: John Snow Labs +name: test_model_1e_4_15e +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_model_1e_4_15e` is a English model originally trained by Yugratna. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_model_1e_4_15e_en_5.4.2_3.0_1724267270094.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_model_1e_4_15e_en_5.4.2_3.0_1724267270094.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_model_1e_4_15e","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_model_1e_4_15e", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_model_1e_4_15e| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.0 MB| + +## References + +https://huggingface.co/Yugratna/test_model_1e_4_15E \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-test_model_1e_4_15e_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-test_model_1e_4_15e_pipeline_en.md new file mode 100644 index 00000000000000..2b6204306d29dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-test_model_1e_4_15e_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_model_1e_4_15e_pipeline pipeline T5Transformer from Yugratna +author: John Snow Labs +name: test_model_1e_4_15e_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_model_1e_4_15e_pipeline` is a English model originally trained by Yugratna. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_model_1e_4_15e_pipeline_en_5.4.2_3.0_1724267290033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_model_1e_4_15e_pipeline_en_5.4.2_3.0_1724267290033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_model_1e_4_15e_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_model_1e_4_15e_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_model_1e_4_15e_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.0 MB| + +## References + +https://huggingface.co/Yugratna/test_model_1e_4_15E + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text2jqlbuilder_en.md b/docs/_posts/ahmedlone127/2024-08-21-text2jqlbuilder_en.md new file mode 100644 index 00000000000000..c239239a94acd4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text2jqlbuilder_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text2jqlbuilder T5Transformer from ManthanKulakarni +author: John Snow Labs +name: text2jqlbuilder +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2jqlbuilder` is a English model originally trained by ManthanKulakarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2jqlbuilder_en_5.4.2_3.0_1724252823627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2jqlbuilder_en_5.4.2_3.0_1724252823627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text2jqlbuilder","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text2jqlbuilder", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2jqlbuilder| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/ManthanKulakarni/Text2JQLBuilder \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text2jqlbuilder_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-text2jqlbuilder_pipeline_en.md new file mode 100644 index 00000000000000..9f0626b10d4da1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text2jqlbuilder_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text2jqlbuilder_pipeline pipeline T5Transformer from ManthanKulakarni +author: John Snow Labs +name: text2jqlbuilder_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2jqlbuilder_pipeline` is a English model originally trained by ManthanKulakarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2jqlbuilder_pipeline_en_5.4.2_3.0_1724252962247.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2jqlbuilder_pipeline_en_5.4.2_3.0_1724252962247.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text2jqlbuilder_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text2jqlbuilder_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2jqlbuilder_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/ManthanKulakarni/Text2JQLBuilder + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v15_en.md b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v15_en.md new file mode 100644 index 00000000000000..2347abcdc788c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v15_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v15 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v15 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v15` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v15_en_5.4.2_3.0_1724200001856.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v15_en_5.4.2_3.0_1724200001856.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v15","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v15", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v15| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|319.4 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v15 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v15_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v15_pipeline_en.md new file mode 100644 index 00000000000000..87108a4f29791e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v15_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v15_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v15_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v15_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v15_pipeline_en_5.4.2_3.0_1724200022331.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v15_pipeline_en_5.4.2_3.0_1724200022331.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v15_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v15_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v15_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|319.4 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v15 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v55_en.md b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v55_en.md new file mode 100644 index 00000000000000..85ad427df44307 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v55_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v55 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v55 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v55` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v55_en_5.4.2_3.0_1724251866507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v55_en_5.4.2_3.0_1724251866507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v55","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v55", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v55| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v55 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v55_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v55_pipeline_en.md new file mode 100644 index 00000000000000..5eeb47ce3e69be --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v55_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v55_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v55_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v55_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v55_pipeline_en_5.4.2_3.0_1724251883239.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v55_pipeline_en_5.4.2_3.0_1724251883239.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v55_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v55_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v55_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v55 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v68_en.md b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v68_en.md new file mode 100644 index 00000000000000..22ba8a4305287a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v68_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v68 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v68 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v68` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v68_en_5.4.2_3.0_1724269067333.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v68_en_5.4.2_3.0_1724269067333.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v68","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v68", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v68| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.5 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v68 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v68_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v68_pipeline_en.md new file mode 100644 index 00000000000000..4d1c675e943978 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text_shortening_model_v68_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v68_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v68_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v68_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v68_pipeline_en_5.4.2_3.0_1724269087683.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v68_pipeline_en_5.4.2_3.0_1724269087683.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v68_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v68_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v68_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.5 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v68 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text_summarization_model_12042024_en.md b/docs/_posts/ahmedlone127/2024-08-21-text_summarization_model_12042024_en.md new file mode 100644 index 00000000000000..92f195a9484472 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text_summarization_model_12042024_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_summarization_model_12042024 T5Transformer from vishnun0027 +author: John Snow Labs +name: text_summarization_model_12042024 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_model_12042024` is a English model originally trained by vishnun0027. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_model_12042024_en_5.4.2_3.0_1724283816811.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_model_12042024_en_5.4.2_3.0_1724283816811.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_summarization_model_12042024","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_summarization_model_12042024", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_model_12042024| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/vishnun0027/Text_Summarization_model_12042024 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-text_summarization_model_12042024_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-text_summarization_model_12042024_pipeline_en.md new file mode 100644 index 00000000000000..aad289c23d29bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-text_summarization_model_12042024_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_summarization_model_12042024_pipeline pipeline T5Transformer from vishnun0027 +author: John Snow Labs +name: text_summarization_model_12042024_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_summarization_model_12042024_pipeline` is a English model originally trained by vishnun0027. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_summarization_model_12042024_pipeline_en_5.4.2_3.0_1724283834982.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_summarization_model_12042024_pipeline_en_5.4.2_3.0_1724283834982.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_summarization_model_12042024_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_summarization_model_12042024_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_summarization_model_12042024_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/vishnun0027/Text_Summarization_model_12042024 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-tiny30m_1020_en.md b/docs/_posts/ahmedlone127/2024-08-21-tiny30m_1020_en.md new file mode 100644 index 00000000000000..2509dbe52809b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-tiny30m_1020_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tiny30m_1020 T5Transformer from mimi33 +author: John Snow Labs +name: tiny30m_1020 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tiny30m_1020` is a English model originally trained by mimi33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tiny30m_1020_en_5.4.2_3.0_1724274025038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tiny30m_1020_en_5.4.2_3.0_1724274025038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tiny30m_1020","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tiny30m_1020", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tiny30m_1020| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|151.1 MB| + +## References + +https://huggingface.co/mimi33/Tiny30M_1020 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-tiny30m_1020_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-tiny30m_1020_pipeline_en.md new file mode 100644 index 00000000000000..beba101e9f84a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-tiny30m_1020_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tiny30m_1020_pipeline pipeline T5Transformer from mimi33 +author: John Snow Labs +name: tiny30m_1020_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tiny30m_1020_pipeline` is a English model originally trained by mimi33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tiny30m_1020_pipeline_en_5.4.2_3.0_1724274032415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tiny30m_1020_pipeline_en_5.4.2_3.0_1724274032415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tiny30m_1020_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tiny30m_1020_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tiny30m_1020_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|151.1 MB| + +## References + +https://huggingface.co/mimi33/Tiny30M_1020 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-translation_t5_base_standard_bahasa_cased_ms.md b/docs/_posts/ahmedlone127/2024-08-21-translation_t5_base_standard_bahasa_cased_ms.md new file mode 100644 index 00000000000000..1038ea7fdb3b67 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-translation_t5_base_standard_bahasa_cased_ms.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Malay (macrolanguage) translation_t5_base_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: translation_t5_base_standard_bahasa_cased +date: 2024-08-21 +tags: [ms, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ms +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_t5_base_standard_bahasa_cased` is a Malay (macrolanguage) model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_t5_base_standard_bahasa_cased_ms_5.4.2_3.0_1724244873466.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_t5_base_standard_bahasa_cased_ms_5.4.2_3.0_1724244873466.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("translation_t5_base_standard_bahasa_cased","ms") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("translation_t5_base_standard_bahasa_cased", "ms") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_t5_base_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ms| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mesolitica/translation-t5-base-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-translation_t5_base_standard_bahasa_cased_pipeline_ms.md b/docs/_posts/ahmedlone127/2024-08-21-translation_t5_base_standard_bahasa_cased_pipeline_ms.md new file mode 100644 index 00000000000000..4e951659b9858c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-translation_t5_base_standard_bahasa_cased_pipeline_ms.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Malay (macrolanguage) translation_t5_base_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: translation_t5_base_standard_bahasa_cased_pipeline +date: 2024-08-21 +tags: [ms, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ms +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`translation_t5_base_standard_bahasa_cased_pipeline` is a Malay (macrolanguage) model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/translation_t5_base_standard_bahasa_cased_pipeline_ms_5.4.2_3.0_1724244925539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/translation_t5_base_standard_bahasa_cased_pipeline_ms_5.4.2_3.0_1724244925539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("translation_t5_base_standard_bahasa_cased_pipeline", lang = "ms") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("translation_t5_base_standard_bahasa_cased_pipeline", lang = "ms") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|translation_t5_base_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ms| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mesolitica/translation-t5-base-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-turkmen_base_minus_sentiment_analysis_en.md b/docs/_posts/ahmedlone127/2024-08-21-turkmen_base_minus_sentiment_analysis_en.md new file mode 100644 index 00000000000000..5daa86ed38d5f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-turkmen_base_minus_sentiment_analysis_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_base_minus_sentiment_analysis T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_base_minus_sentiment_analysis +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_base_minus_sentiment_analysis` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_base_minus_sentiment_analysis_en_5.4.2_3.0_1724204955366.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_base_minus_sentiment_analysis_en_5.4.2_3.0_1724204955366.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_base_minus_sentiment_analysis","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_base_minus_sentiment_analysis", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_base_minus_sentiment_analysis| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.4 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-base-minus-sentiment-analysis \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-turkmen_base_minus_sentiment_analysis_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-turkmen_base_minus_sentiment_analysis_pipeline_en.md new file mode 100644 index 00000000000000..d74e9d106689d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-turkmen_base_minus_sentiment_analysis_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkmen_base_minus_sentiment_analysis_pipeline pipeline T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_base_minus_sentiment_analysis_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_base_minus_sentiment_analysis_pipeline` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_base_minus_sentiment_analysis_pipeline_en_5.4.2_3.0_1724205129771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_base_minus_sentiment_analysis_pipeline_en_5.4.2_3.0_1724205129771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkmen_base_minus_sentiment_analysis_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkmen_base_minus_sentiment_analysis_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_base_minus_sentiment_analysis_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.4 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-base-minus-sentiment-analysis + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-turkmen_instruct_squad_base_3_en.md b/docs/_posts/ahmedlone127/2024-08-21-turkmen_instruct_squad_base_3_en.md new file mode 100644 index 00000000000000..b397eaede87c62 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-turkmen_instruct_squad_base_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_squad_base_3 T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_base_3 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_base_3` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_3_en_5.4.2_3.0_1724280171828.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_3_en_5.4.2_3.0_1724280171828.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_squad_base_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_squad_base_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_base_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.5 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-base-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-turkmen_instruct_squad_base_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-turkmen_instruct_squad_base_3_pipeline_en.md new file mode 100644 index 00000000000000..56387743b331ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-turkmen_instruct_squad_base_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkmen_instruct_squad_base_3_pipeline pipeline T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_base_3_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_base_3_pipeline` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_3_pipeline_en_5.4.2_3.0_1724280347215.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_base_3_pipeline_en_5.4.2_3.0_1724280347215.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkmen_instruct_squad_base_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkmen_instruct_squad_base_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_base_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.6 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-base-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_en.md b/docs/_posts/ahmedlone127/2024-08-21-unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_en.md new file mode 100644 index 00000000000000..b3eb40825dfc06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa T5Transformer from makanju0la +author: John Snow Labs +name: unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa` is a English model originally trained by makanju0la. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_en_5.4.2_3.0_1724242068734.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_en_5.4.2_3.0_1724242068734.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|961.5 MB| + +## References + +https://huggingface.co/makanju0la/unifiedqa-v2-t5-base-1363200-finetuned-qa-doqa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline_en.md new file mode 100644 index 00000000000000..682e2182ced64a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline pipeline T5Transformer from makanju0la +author: John Snow Labs +name: unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline` is a English model originally trained by makanju0la. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline_en_5.4.2_3.0_1724242130462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline_en_5.4.2_3.0_1724242130462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unifiedqa_v2_t5_base_1363200_finetuned_qa_doqa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|961.5 MB| + +## References + +https://huggingface.co/makanju0la/unifiedqa-v2-t5-base-1363200-finetuned-qa-doqa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-urt5_base_init_en.md b/docs/_posts/ahmedlone127/2024-08-21-urt5_base_init_en.md new file mode 100644 index 00000000000000..5ecf8c18a8ca6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-urt5_base_init_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English urt5_base_init T5Transformer from mbshr +author: John Snow Labs +name: urt5_base_init +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`urt5_base_init` is a English model originally trained by mbshr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/urt5_base_init_en_5.4.2_3.0_1724253765742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/urt5_base_init_en_5.4.2_3.0_1724253765742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("urt5_base_init","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("urt5_base_init", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|urt5_base_init| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|533.2 MB| + +## References + +https://huggingface.co/mbshr/urt5-base-init \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-urt5_base_init_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-urt5_base_init_pipeline_en.md new file mode 100644 index 00000000000000..28faeb308d9e56 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-urt5_base_init_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English urt5_base_init_pipeline pipeline T5Transformer from mbshr +author: John Snow Labs +name: urt5_base_init_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`urt5_base_init_pipeline` is a English model originally trained by mbshr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/urt5_base_init_pipeline_en_5.4.2_3.0_1724253949901.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/urt5_base_init_pipeline_en_5.4.2_3.0_1724253949901.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("urt5_base_init_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("urt5_base_init_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|urt5_base_init_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|533.2 MB| + +## References + +https://huggingface.co/mbshr/urt5-base-init + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-v4_en.md b/docs/_posts/ahmedlone127/2024-08-21-v4_en.md new file mode 100644 index 00000000000000..ea66412e3429f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English v4 T5Transformer from vansin +author: John Snow Labs +name: v4 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`v4` is a English model originally trained by vansin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/v4_en_5.4.2_3.0_1724259796690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/v4_en_5.4.2_3.0_1724259796690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|61.6 MB| + +## References + +https://huggingface.co/vansin/v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-v4_pipeline_en.md new file mode 100644 index 00000000000000..d05aa5d9f2ac39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English v4_pipeline pipeline T5Transformer from vansin +author: John Snow Labs +name: v4_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`v4_pipeline` is a English model originally trained by vansin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/v4_pipeline_en_5.4.2_3.0_1724259818624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/v4_pipeline_en_5.4.2_3.0_1724259818624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|61.6 MB| + +## References + +https://huggingface.co/vansin/v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs16k_en.md b/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs16k_en.md new file mode 100644 index 00000000000000..83600fa611595c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs16k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vanilla_mt5_tiny4l_vs16k T5Transformer from kyoyanagi +author: John Snow Labs +name: vanilla_mt5_tiny4l_vs16k +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vanilla_mt5_tiny4l_vs16k` is a English model originally trained by kyoyanagi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny4l_vs16k_en_5.4.2_3.0_1724241618586.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny4l_vs16k_en_5.4.2_3.0_1724241618586.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vanilla_mt5_tiny4l_vs16k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vanilla_mt5_tiny4l_vs16k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vanilla_mt5_tiny4l_vs16k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|75.6 MB| + +## References + +https://huggingface.co/kyoyanagi/vanilla-mt5-tiny4L-vs16k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs16k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs16k_pipeline_en.md new file mode 100644 index 00000000000000..b9d33ddbe9e31a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs16k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vanilla_mt5_tiny4l_vs16k_pipeline pipeline T5Transformer from kyoyanagi +author: John Snow Labs +name: vanilla_mt5_tiny4l_vs16k_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vanilla_mt5_tiny4l_vs16k_pipeline` is a English model originally trained by kyoyanagi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny4l_vs16k_pipeline_en_5.4.2_3.0_1724241622607.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny4l_vs16k_pipeline_en_5.4.2_3.0_1724241622607.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vanilla_mt5_tiny4l_vs16k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vanilla_mt5_tiny4l_vs16k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vanilla_mt5_tiny4l_vs16k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|75.6 MB| + +## References + +https://huggingface.co/kyoyanagi/vanilla-mt5-tiny4L-vs16k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs32k_en.md b/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs32k_en.md new file mode 100644 index 00000000000000..fd09bb6f9a7117 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs32k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vanilla_mt5_tiny4l_vs32k T5Transformer from mimi33 +author: John Snow Labs +name: vanilla_mt5_tiny4l_vs32k +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vanilla_mt5_tiny4l_vs32k` is a English model originally trained by mimi33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny4l_vs32k_en_5.4.2_3.0_1724249277932.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny4l_vs32k_en_5.4.2_3.0_1724249277932.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vanilla_mt5_tiny4l_vs32k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vanilla_mt5_tiny4l_vs32k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vanilla_mt5_tiny4l_vs32k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|121.7 MB| + +## References + +https://huggingface.co/mimi33/vanilla-mt5-tiny4L-vs32k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs32k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs32k_pipeline_en.md new file mode 100644 index 00000000000000..ae4cc06025cd83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vanilla_mt5_tiny4l_vs32k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vanilla_mt5_tiny4l_vs32k_pipeline pipeline T5Transformer from mimi33 +author: John Snow Labs +name: vanilla_mt5_tiny4l_vs32k_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vanilla_mt5_tiny4l_vs32k_pipeline` is a English model originally trained by mimi33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny4l_vs32k_pipeline_en_5.4.2_3.0_1724249283955.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vanilla_mt5_tiny4l_vs32k_pipeline_en_5.4.2_3.0_1724249283955.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vanilla_mt5_tiny4l_vs32k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vanilla_mt5_tiny4l_vs32k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vanilla_mt5_tiny4l_vs32k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|121.7 MB| + +## References + +https://huggingface.co/mimi33/vanilla-mt5-tiny4L-vs32k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_envit5_base_docs_news_train_en.md b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_envit5_base_docs_news_train_en.md new file mode 100644 index 00000000000000..d310ca6ffda177 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_envit5_base_docs_news_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_envit5_base_docs_news_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_base_docs_news_train +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_base_docs_news_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_docs_news_train_en_5.4.2_3.0_1724267224281.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_docs_news_train_en_5.4.2_3.0_1724267224281.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_envit5_base_docs_news_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_envit5_base_docs_news_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_base_docs_news_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-base_docs_news_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_envit5_base_docs_news_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_envit5_base_docs_news_train_pipeline_en.md new file mode 100644 index 00000000000000..cf3c232c47565d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_envit5_base_docs_news_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_envit5_base_docs_news_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_base_docs_news_train_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_base_docs_news_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_docs_news_train_pipeline_en_5.4.2_3.0_1724267294306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_docs_news_train_pipeline_en_5.4.2_3.0_1724267294306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_envit5_base_docs_news_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_envit5_base_docs_news_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_base_docs_news_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-base_docs_news_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_doc_train_en.md b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_doc_train_en.md new file mode 100644 index 00000000000000..288dfc4f9856ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_doc_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_mt5_base_doc_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_mt5_base_doc_train +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_mt5_base_doc_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_doc_train_en_5.4.2_3.0_1724264169282.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_doc_train_en_5.4.2_3.0_1724264169282.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_mt5_base_doc_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_mt5_base_doc_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_mt5_base_doc_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_mt5-base_doc_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_doc_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_doc_train_pipeline_en.md new file mode 100644 index 00000000000000..e629f7f9210fc6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_doc_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_mt5_base_doc_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_mt5_base_doc_train_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_mt5_base_doc_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_doc_train_pipeline_en_5.4.2_3.0_1724264449869.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_doc_train_pipeline_en_5.4.2_3.0_1724264449869.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_mt5_base_doc_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_mt5_base_doc_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_mt5_base_doc_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_mt5-base_doc_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_docs_news_train_en.md b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_docs_news_train_en.md new file mode 100644 index 00000000000000..18f75f760b64a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_docs_news_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_mt5_base_docs_news_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_mt5_base_docs_news_train +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_mt5_base_docs_news_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_docs_news_train_en_5.4.2_3.0_1724264652959.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_docs_news_train_en_5.4.2_3.0_1724264652959.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_mt5_base_docs_news_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_mt5_base_docs_news_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_mt5_base_docs_news_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_mt5-base_docs_news_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_docs_news_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_docs_news_train_pipeline_en.md new file mode 100644 index 00000000000000..eef7750c7e2adb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vietnamese_english_mt5_base_docs_news_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_mt5_base_docs_news_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_mt5_base_docs_news_train_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_mt5_base_docs_news_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_docs_news_train_pipeline_en_5.4.2_3.0_1724264926220.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_mt5_base_docs_news_train_pipeline_en_5.4.2_3.0_1724264926220.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_mt5_base_docs_news_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_mt5_base_docs_news_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_mt5_base_docs_news_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_mt5-base_docs_news_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vit5_base_finetuned_vn_anhmanucian190302_en.md b/docs/_posts/ahmedlone127/2024-08-21-vit5_base_finetuned_vn_anhmanucian190302_en.md new file mode 100644 index 00000000000000..46c85c5e878e04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vit5_base_finetuned_vn_anhmanucian190302_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_finetuned_vn_anhmanucian190302 T5Transformer from anhmanucian190302 +author: John Snow Labs +name: vit5_base_finetuned_vn_anhmanucian190302 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_finetuned_vn_anhmanucian190302` is a English model originally trained by anhmanucian190302. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_anhmanucian190302_en_5.4.2_3.0_1724226205139.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_anhmanucian190302_en_5.4.2_3.0_1724226205139.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_finetuned_vn_anhmanucian190302","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_finetuned_vn_anhmanucian190302", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_finetuned_vn_anhmanucian190302| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/anhmanucian190302/vit5-base-finetuned-VN \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vit5_base_finetuned_vn_anhmanucian190302_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-vit5_base_finetuned_vn_anhmanucian190302_pipeline_en.md new file mode 100644 index 00000000000000..6ebb4ca11b6a1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vit5_base_finetuned_vn_anhmanucian190302_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_finetuned_vn_anhmanucian190302_pipeline pipeline T5Transformer from anhmanucian190302 +author: John Snow Labs +name: vit5_base_finetuned_vn_anhmanucian190302_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_finetuned_vn_anhmanucian190302_pipeline` is a English model originally trained by anhmanucian190302. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_anhmanucian190302_pipeline_en_5.4.2_3.0_1724226256841.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_anhmanucian190302_pipeline_en_5.4.2_3.0_1724226256841.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_finetuned_vn_anhmanucian190302_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_finetuned_vn_anhmanucian190302_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_finetuned_vn_anhmanucian190302_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/anhmanucian190302/vit5-base-finetuned-VN + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vit5_base_summarize_task_split_v2_en.md b/docs/_posts/ahmedlone127/2024-08-21-vit5_base_summarize_task_split_v2_en.md new file mode 100644 index 00000000000000..6c9a2b8d182e09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vit5_base_summarize_task_split_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_summarize_task_split_v2 T5Transformer from Redgalaxy2 +author: John Snow Labs +name: vit5_base_summarize_task_split_v2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_summarize_task_split_v2` is a English model originally trained by Redgalaxy2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_summarize_task_split_v2_en_5.4.2_3.0_1724209810078.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_summarize_task_split_v2_en_5.4.2_3.0_1724209810078.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_summarize_task_split_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_summarize_task_split_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_summarize_task_split_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Redgalaxy2/vit5-base-summarize-task-split-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-vit5_base_summarize_task_split_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-vit5_base_summarize_task_split_v2_pipeline_en.md new file mode 100644 index 00000000000000..4a97d764e3cb6d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-vit5_base_summarize_task_split_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_summarize_task_split_v2_pipeline pipeline T5Transformer from Redgalaxy2 +author: John Snow Labs +name: vit5_base_summarize_task_split_v2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_summarize_task_split_v2_pipeline` is a English model originally trained by Redgalaxy2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_summarize_task_split_v2_pipeline_en_5.4.2_3.0_1724209864448.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_summarize_task_split_v2_pipeline_en_5.4.2_3.0_1724209864448.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_summarize_task_split_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_summarize_task_split_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_summarize_task_split_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Redgalaxy2/vit5-base-summarize-task-split-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-wanduoibau_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-wanduoibau_model_pipeline_en.md new file mode 100644 index 00000000000000..40a12376015487 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-wanduoibau_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English wanduoibau_model_pipeline pipeline T5Transformer from nbui1904 +author: John Snow Labs +name: wanduoibau_model_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wanduoibau_model_pipeline` is a English model originally trained by nbui1904. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wanduoibau_model_pipeline_en_5.4.2_3.0_1724255730268.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wanduoibau_model_pipeline_en_5.4.2_3.0_1724255730268.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("wanduoibau_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("wanduoibau_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wanduoibau_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/nbui1904/wanduoibau_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-xsum_aligned_smallt5_cont3_en.md b/docs/_posts/ahmedlone127/2024-08-21-xsum_aligned_smallt5_cont3_en.md new file mode 100644 index 00000000000000..6caaf6cae08b9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-xsum_aligned_smallt5_cont3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_aligned_smallt5_cont3 T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_cont3 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_cont3` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_cont3_en_5.4.2_3.0_1724284098144.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_cont3_en_5.4.2_3.0_1724284098144.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_aligned_smallt5_cont3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_aligned_smallt5_cont3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_cont3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5_cont3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-xsum_aligned_smallt5_cont3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-xsum_aligned_smallt5_cont3_pipeline_en.md new file mode 100644 index 00000000000000..cedafe13082209 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-xsum_aligned_smallt5_cont3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_aligned_smallt5_cont3_pipeline pipeline T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_cont3_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_cont3_pipeline` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_cont3_pipeline_en_5.4.2_3.0_1724284114933.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_cont3_pipeline_en_5.4.2_3.0_1724284114933.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_aligned_smallt5_cont3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_aligned_smallt5_cont3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_cont3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5_cont3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-xsum_finetuned_on_train2_en.md b/docs/_posts/ahmedlone127/2024-08-21-xsum_finetuned_on_train2_en.md new file mode 100644 index 00000000000000..c62c14566a60e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-xsum_finetuned_on_train2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_finetuned_on_train2 T5Transformer from mpalaval +author: John Snow Labs +name: xsum_finetuned_on_train2 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_finetuned_on_train2` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_finetuned_on_train2_en_5.4.2_3.0_1724283638477.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_finetuned_on_train2_en_5.4.2_3.0_1724283638477.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_finetuned_on_train2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_finetuned_on_train2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_finetuned_on_train2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|996.9 MB| + +## References + +https://huggingface.co/mpalaval/xsum_finetuned_on_train2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-xsum_finetuned_on_train2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-xsum_finetuned_on_train2_pipeline_en.md new file mode 100644 index 00000000000000..6e92cbf1e29107 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-xsum_finetuned_on_train2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_finetuned_on_train2_pipeline pipeline T5Transformer from mpalaval +author: John Snow Labs +name: xsum_finetuned_on_train2_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_finetuned_on_train2_pipeline` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_finetuned_on_train2_pipeline_en_5.4.2_3.0_1724283689188.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_finetuned_on_train2_pipeline_en_5.4.2_3.0_1724283689188.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_finetuned_on_train2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_finetuned_on_train2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_finetuned_on_train2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|996.9 MB| + +## References + +https://huggingface.co/mpalaval/xsum_finetuned_on_train2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-yelp_polarity_t5_small_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-21-yelp_polarity_t5_small_seed_1_en.md new file mode 100644 index 00000000000000..7f3e79a8683c72 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-yelp_polarity_t5_small_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English yelp_polarity_t5_small_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: yelp_polarity_t5_small_seed_1 +date: 2024-08-21 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`yelp_polarity_t5_small_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_small_seed_1_en_5.4.2_3.0_1724235438030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_small_seed_1_en_5.4.2_3.0_1724235438030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("yelp_polarity_t5_small_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("yelp_polarity_t5_small_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|yelp_polarity_t5_small_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/utahnlp/yelp_polarity_t5-small_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-21-yelp_polarity_t5_small_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-21-yelp_polarity_t5_small_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..94594e3c008a79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-21-yelp_polarity_t5_small_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English yelp_polarity_t5_small_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: yelp_polarity_t5_small_seed_1_pipeline +date: 2024-08-21 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`yelp_polarity_t5_small_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_small_seed_1_pipeline_en_5.4.2_3.0_1724235457179.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/yelp_polarity_t5_small_seed_1_pipeline_en_5.4.2_3.0_1724235457179.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("yelp_polarity_t5_small_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("yelp_polarity_t5_small_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|yelp_polarity_t5_small_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/utahnlp/yelp_polarity_t5-small_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-12412fsasf_en.md b/docs/_posts/ahmedlone127/2024-08-22-12412fsasf_en.md new file mode 100644 index 00000000000000..80452293148dbe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-12412fsasf_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 12412fsasf T5Transformer from p-christ +author: John Snow Labs +name: 12412fsasf +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`12412fsasf` is a English model originally trained by p-christ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/12412fsasf_en_5.4.2_3.0_1724319728904.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/12412fsasf_en_5.4.2_3.0_1724319728904.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("12412fsasf","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("12412fsasf", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|12412fsasf| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/p-christ/12412fsasf \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-12412fsasf_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-12412fsasf_pipeline_en.md new file mode 100644 index 00000000000000..4f09cfc9981525 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-12412fsasf_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 12412fsasf_pipeline pipeline T5Transformer from p-christ +author: John Snow Labs +name: 12412fsasf_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`12412fsasf_pipeline` is a English model originally trained by p-christ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/12412fsasf_pipeline_en_5.4.2_3.0_1724319776067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/12412fsasf_pipeline_en_5.4.2_3.0_1724319776067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("12412fsasf_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("12412fsasf_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|12412fsasf_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/p-christ/12412fsasf + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-1teacherdistillbacktranslate_en.md b/docs/_posts/ahmedlone127/2024-08-22-1teacherdistillbacktranslate_en.md new file mode 100644 index 00000000000000..e045af536d8163 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-1teacherdistillbacktranslate_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 1teacherdistillbacktranslate T5Transformer from j0hngou +author: John Snow Labs +name: 1teacherdistillbacktranslate +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`1teacherdistillbacktranslate` is a English model originally trained by j0hngou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/1teacherdistillbacktranslate_en_5.4.2_3.0_1724347709371.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/1teacherdistillbacktranslate_en_5.4.2_3.0_1724347709371.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("1teacherdistillbacktranslate","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("1teacherdistillbacktranslate", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|1teacherdistillbacktranslate| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/j0hngou/1teacherdistillbacktranslate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-1teacherdistillbacktranslate_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-1teacherdistillbacktranslate_pipeline_en.md new file mode 100644 index 00000000000000..f2deccd4819425 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-1teacherdistillbacktranslate_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 1teacherdistillbacktranslate_pipeline pipeline T5Transformer from j0hngou +author: John Snow Labs +name: 1teacherdistillbacktranslate_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`1teacherdistillbacktranslate_pipeline` is a English model originally trained by j0hngou. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/1teacherdistillbacktranslate_pipeline_en_5.4.2_3.0_1724347726107.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/1teacherdistillbacktranslate_pipeline_en_5.4.2_3.0_1724347726107.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("1teacherdistillbacktranslate_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("1teacherdistillbacktranslate_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|1teacherdistillbacktranslate_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.8 MB| + +## References + +https://huggingface.co/j0hngou/1teacherdistillbacktranslate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-20240110_0_en.md b/docs/_posts/ahmedlone127/2024-08-22-20240110_0_en.md new file mode 100644 index 00000000000000..7823c3139b5c0c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-20240110_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240110_0 T5Transformer from picas9dan +author: John Snow Labs +name: 20240110_0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240110_0` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240110_0_en_5.4.2_3.0_1724344446693.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240110_0_en_5.4.2_3.0_1724344446693.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240110_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240110_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240110_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/picas9dan/20240110_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-20240110_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-20240110_0_pipeline_en.md new file mode 100644 index 00000000000000..f2a80baf2fa5e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-20240110_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240110_0_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240110_0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240110_0_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240110_0_pipeline_en_5.4.2_3.0_1724344466536.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240110_0_pipeline_en_5.4.2_3.0_1724344466536.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240110_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240110_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240110_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/picas9dan/20240110_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-20240110_5_en.md b/docs/_posts/ahmedlone127/2024-08-22-20240110_5_en.md new file mode 100644 index 00000000000000..f285c536ccd25b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-20240110_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240110_5 T5Transformer from picas9dan +author: John Snow Labs +name: 20240110_5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240110_5` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240110_5_en_5.4.2_3.0_1724315773484.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240110_5_en_5.4.2_3.0_1724315773484.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240110_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240110_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240110_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240110_5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-20240110_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-20240110_5_pipeline_en.md new file mode 100644 index 00000000000000..2e155a8336752e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-20240110_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240110_5_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240110_5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240110_5_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240110_5_pipeline_en_5.4.2_3.0_1724315917047.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240110_5_pipeline_en_5.4.2_3.0_1724315917047.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240110_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240110_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240110_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/picas9dan/20240110_5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-20240130_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-20240130_1_en.md new file mode 100644 index 00000000000000..383385c837ad72 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-20240130_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 20240130_1 T5Transformer from picas9dan +author: John Snow Labs +name: 20240130_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240130_1` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240130_1_en_5.4.2_3.0_1724332742357.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240130_1_en_5.4.2_3.0_1724332742357.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("20240130_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("20240130_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240130_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/picas9dan/20240130_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-20240130_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-20240130_1_pipeline_en.md new file mode 100644 index 00000000000000..5336b9d86f57ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-20240130_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 20240130_1_pipeline pipeline T5Transformer from picas9dan +author: John Snow Labs +name: 20240130_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240130_1_pipeline` is a English model originally trained by picas9dan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240130_1_pipeline_en_5.4.2_3.0_1724332760508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240130_1_pipeline_en_5.4.2_3.0_1724332760508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("20240130_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("20240130_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|20240130_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/picas9dan/20240130_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-300ex_100all_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-300ex_100all_t5_small_en.md new file mode 100644 index 00000000000000..0e30cd17c90e05 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-300ex_100all_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 300ex_100all_t5_small T5Transformer from ShokSmile +author: John Snow Labs +name: 300ex_100all_t5_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`300ex_100all_t5_small` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/300ex_100all_t5_small_en_5.4.2_3.0_1724347634445.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/300ex_100all_t5_small_en_5.4.2_3.0_1724347634445.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("300ex_100all_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("300ex_100all_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|300ex_100all_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/ShokSmile/300ex-100all-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-300ex_100all_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-300ex_100all_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..3c4ed751a80f91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-300ex_100all_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 300ex_100all_t5_small_pipeline pipeline T5Transformer from ShokSmile +author: John Snow Labs +name: 300ex_100all_t5_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`300ex_100all_t5_small_pipeline` is a English model originally trained by ShokSmile. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/300ex_100all_t5_small_pipeline_en_5.4.2_3.0_1724347694204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/300ex_100all_t5_small_pipeline_en_5.4.2_3.0_1724347694204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("300ex_100all_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("300ex_100all_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|300ex_100all_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/ShokSmile/300ex-100all-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-3epochisdabest_en.md b/docs/_posts/ahmedlone127/2024-08-22-3epochisdabest_en.md new file mode 100644 index 00000000000000..e8949dee76c5f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-3epochisdabest_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 3epochisdabest T5Transformer from atulxop +author: John Snow Labs +name: 3epochisdabest +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`3epochisdabest` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/3epochisdabest_en_5.4.2_3.0_1724367726692.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/3epochisdabest_en_5.4.2_3.0_1724367726692.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("3epochisdabest","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("3epochisdabest", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|3epochisdabest| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/atulxop/3epochisdabest \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-3epochisdabest_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-3epochisdabest_pipeline_en.md new file mode 100644 index 00000000000000..6ed8ac62e622a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-3epochisdabest_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 3epochisdabest_pipeline pipeline T5Transformer from atulxop +author: John Snow Labs +name: 3epochisdabest_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`3epochisdabest_pipeline` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/3epochisdabest_pipeline_en_5.4.2_3.0_1724367744207.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/3epochisdabest_pipeline_en_5.4.2_3.0_1724367744207.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("3epochisdabest_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("3epochisdabest_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|3epochisdabest_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/atulxop/3epochisdabest + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-7epochisdabest_en.md b/docs/_posts/ahmedlone127/2024-08-22-7epochisdabest_en.md new file mode 100644 index 00000000000000..dff96e90afb3b7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-7epochisdabest_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English 7epochisdabest T5Transformer from atulxop +author: John Snow Labs +name: 7epochisdabest +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`7epochisdabest` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/7epochisdabest_en_5.4.2_3.0_1724358804689.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/7epochisdabest_en_5.4.2_3.0_1724358804689.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("7epochisdabest","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("7epochisdabest", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|7epochisdabest| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.0 MB| + +## References + +https://huggingface.co/atulxop/7epochisdabest \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-7epochisdabest_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-7epochisdabest_pipeline_en.md new file mode 100644 index 00000000000000..fbabbeb3ea5221 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-7epochisdabest_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English 7epochisdabest_pipeline pipeline T5Transformer from atulxop +author: John Snow Labs +name: 7epochisdabest_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`7epochisdabest_pipeline` is a English model originally trained by atulxop. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/7epochisdabest_pipeline_en_5.4.2_3.0_1724358821528.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/7epochisdabest_pipeline_en_5.4.2_3.0_1724358821528.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("7epochisdabest_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("7epochisdabest_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|7epochisdabest_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.0 MB| + +## References + +https://huggingface.co/atulxop/7epochisdabest + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-aaa_sql_en.md b/docs/_posts/ahmedlone127/2024-08-22-aaa_sql_en.md new file mode 100644 index 00000000000000..73f19432be4712 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-aaa_sql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English aaa_sql T5Transformer from abdullahsn +author: John Snow Labs +name: aaa_sql +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`aaa_sql` is a English model originally trained by abdullahsn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/aaa_sql_en_5.4.2_3.0_1724295162296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/aaa_sql_en_5.4.2_3.0_1724295162296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("aaa_sql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("aaa_sql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|aaa_sql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/abdullahsn/AAA-SQL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-aaa_sql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-aaa_sql_pipeline_en.md new file mode 100644 index 00000000000000..ad9a45873e6eae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-aaa_sql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English aaa_sql_pipeline pipeline T5Transformer from abdullahsn +author: John Snow Labs +name: aaa_sql_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`aaa_sql_pipeline` is a English model originally trained by abdullahsn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/aaa_sql_pipeline_en_5.4.2_3.0_1724295245524.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/aaa_sql_pipeline_en_5.4.2_3.0_1724295245524.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("aaa_sql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("aaa_sql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|aaa_sql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/abdullahsn/AAA-SQL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-afrikans_sum_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-afrikans_sum_v2_en.md new file mode 100644 index 00000000000000..fce6876ef3a8e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-afrikans_sum_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English afrikans_sum_v2 T5Transformer from mHossain +author: John Snow Labs +name: afrikans_sum_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrikans_sum_v2` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrikans_sum_v2_en_5.4.2_3.0_1724310818782.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrikans_sum_v2_en_5.4.2_3.0_1724310818782.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("afrikans_sum_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("afrikans_sum_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrikans_sum_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|292.8 MB| + +## References + +https://huggingface.co/mHossain/afrikans_sum_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-afrikans_sum_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-afrikans_sum_v2_pipeline_en.md new file mode 100644 index 00000000000000..43b88d06f1a383 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-afrikans_sum_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English afrikans_sum_v2_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: afrikans_sum_v2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`afrikans_sum_v2_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/afrikans_sum_v2_pipeline_en_5.4.2_3.0_1724310848360.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/afrikans_sum_v2_pipeline_en_5.4.2_3.0_1724310848360.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("afrikans_sum_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("afrikans_sum_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|afrikans_sum_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|292.8 MB| + +## References + +https://huggingface.co/mHossain/afrikans_sum_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ag_news_t5_base_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-22-ag_news_t5_base_seed_3_en.md new file mode 100644 index 00000000000000..c6094b30988cfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ag_news_t5_base_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ag_news_t5_base_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: ag_news_t5_base_seed_3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ag_news_t5_base_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ag_news_t5_base_seed_3_en_5.4.2_3.0_1724299311338.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ag_news_t5_base_seed_3_en_5.4.2_3.0_1724299311338.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ag_news_t5_base_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ag_news_t5_base_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ag_news_t5_base_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|997.5 MB| + +## References + +https://huggingface.co/utahnlp/ag_news_t5-base_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ag_news_t5_base_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-ag_news_t5_base_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..826dd043a8050a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ag_news_t5_base_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ag_news_t5_base_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: ag_news_t5_base_seed_3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ag_news_t5_base_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ag_news_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724299367704.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ag_news_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724299367704.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ag_news_t5_base_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ag_news_t5_base_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ag_news_t5_base_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|997.6 MB| + +## References + +https://huggingface.co/utahnlp/ag_news_t5-base_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-aki1026_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-aki1026_1_en.md new file mode 100644 index 00000000000000..54f3ef42e2682c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-aki1026_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English aki1026_1 T5Transformer from aki-y +author: John Snow Labs +name: aki1026_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`aki1026_1` is a English model originally trained by aki-y. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/aki1026_1_en_5.4.2_3.0_1724313913221.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/aki1026_1_en_5.4.2_3.0_1724313913221.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("aki1026_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("aki1026_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|aki1026_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|151.4 MB| + +## References + +https://huggingface.co/aki-y/aki1026-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-aki1026_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-aki1026_1_pipeline_en.md new file mode 100644 index 00000000000000..5871651a05ff77 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-aki1026_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English aki1026_1_pipeline pipeline T5Transformer from aki-y +author: John Snow Labs +name: aki1026_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`aki1026_1_pipeline` is a English model originally trained by aki-y. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/aki1026_1_pipeline_en_5.4.2_3.0_1724313920304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/aki1026_1_pipeline_en_5.4.2_3.0_1724313920304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("aki1026_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("aki1026_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|aki1026_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|151.4 MB| + +## References + +https://huggingface.co/aki-y/aki1026-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_15_spider_15_wikisql_nepal_bhasa_en.md b/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_15_spider_15_wikisql_nepal_bhasa_en.md new file mode 100644 index 00000000000000..373a828f2b7730 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_15_spider_15_wikisql_nepal_bhasa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5_base_15_spider_15_wikisql_nepal_bhasa T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_15_spider_15_wikisql_nepal_bhasa +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_15_spider_15_wikisql_nepal_bhasa` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_15_wikisql_nepal_bhasa_en_5.4.2_3.0_1724285262829.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_15_wikisql_nepal_bhasa_en_5.4.2_3.0_1724285262829.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5_base_15_spider_15_wikisql_nepal_bhasa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5_base_15_spider_15_wikisql_nepal_bhasa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_15_spider_15_wikisql_nepal_bhasa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_15_spider_15_wikiSQL_new \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline_en.md new file mode 100644 index 00000000000000..9e12a63baa475e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline_en_5.4.2_3.0_1724285529278.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline_en_5.4.2_3.0_1724285529278.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_15_spider_15_wikisql_nepal_bhasa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_15_spider_15_wikiSQL_new + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_5_spider_15_wikisql_nepal_bhasa_en.md b/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_5_spider_15_wikisql_nepal_bhasa_en.md new file mode 100644 index 00000000000000..2092434db88534 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_5_spider_15_wikisql_nepal_bhasa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English all_mt5_base_5_spider_15_wikisql_nepal_bhasa T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_5_spider_15_wikisql_nepal_bhasa +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_5_spider_15_wikisql_nepal_bhasa` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_5_spider_15_wikisql_nepal_bhasa_en_5.4.2_3.0_1724360522900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_5_spider_15_wikisql_nepal_bhasa_en_5.4.2_3.0_1724360522900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("all_mt5_base_5_spider_15_wikisql_nepal_bhasa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("all_mt5_base_5_spider_15_wikisql_nepal_bhasa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_5_spider_15_wikisql_nepal_bhasa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_5_spider_15_wikiSQL_new \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline_en.md new file mode 100644 index 00000000000000..1931d2c7deba83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline_en_5.4.2_3.0_1724360785128.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline_en_5.4.2_3.0_1724360785128.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|all_mt5_base_5_spider_15_wikisql_nepal_bhasa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/e22vvb/ALL_mt5-base_5_spider_15_wikiSQL_new + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-alqalam_finetuned_mmj_withxlsum_en.md b/docs/_posts/ahmedlone127/2024-08-22-alqalam_finetuned_mmj_withxlsum_en.md new file mode 100644 index 00000000000000..51749ae2eac427 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-alqalam_finetuned_mmj_withxlsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English alqalam_finetuned_mmj_withxlsum T5Transformer from youssefhany97 +author: John Snow Labs +name: alqalam_finetuned_mmj_withxlsum +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`alqalam_finetuned_mmj_withxlsum` is a English model originally trained by youssefhany97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/alqalam_finetuned_mmj_withxlsum_en_5.4.2_3.0_1724329187763.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/alqalam_finetuned_mmj_withxlsum_en_5.4.2_3.0_1724329187763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("alqalam_finetuned_mmj_withxlsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("alqalam_finetuned_mmj_withxlsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|alqalam_finetuned_mmj_withxlsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/youssefhany97/AlQalam-finetuned-mmj-withXlsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-alqalam_finetuned_mmj_withxlsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-alqalam_finetuned_mmj_withxlsum_pipeline_en.md new file mode 100644 index 00000000000000..60dd0f76bc2153 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-alqalam_finetuned_mmj_withxlsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English alqalam_finetuned_mmj_withxlsum_pipeline pipeline T5Transformer from youssefhany97 +author: John Snow Labs +name: alqalam_finetuned_mmj_withxlsum_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`alqalam_finetuned_mmj_withxlsum_pipeline` is a English model originally trained by youssefhany97. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/alqalam_finetuned_mmj_withxlsum_pipeline_en_5.4.2_3.0_1724329267297.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/alqalam_finetuned_mmj_withxlsum_pipeline_en_5.4.2_3.0_1724329267297.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("alqalam_finetuned_mmj_withxlsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("alqalam_finetuned_mmj_withxlsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|alqalam_finetuned_mmj_withxlsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/youssefhany97/AlQalam-finetuned-mmj-withXlsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-amt5_base_en.md b/docs/_posts/ahmedlone127/2024-08-22-amt5_base_en.md new file mode 100644 index 00000000000000..79418d25031a71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-amt5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English amt5_base T5Transformer from Samuael +author: John Snow Labs +name: amt5_base +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`amt5_base` is a English model originally trained by Samuael. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/amt5_base_en_5.4.2_3.0_1724308383750.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/amt5_base_en_5.4.2_3.0_1724308383750.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("amt5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("amt5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|amt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|388.0 MB| + +## References + +https://huggingface.co/Samuael/amt5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-amt5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-amt5_base_pipeline_en.md new file mode 100644 index 00000000000000..f24fd24aa801c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-amt5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English amt5_base_pipeline pipeline T5Transformer from Samuael +author: John Snow Labs +name: amt5_base_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`amt5_base_pipeline` is a English model originally trained by Samuael. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/amt5_base_pipeline_en_5.4.2_3.0_1724308514363.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/amt5_base_pipeline_en_5.4.2_3.0_1724308514363.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("amt5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("amt5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|amt5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|388.0 MB| + +## References + +https://huggingface.co/Samuael/amt5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-arat5_spiderdataset_en.md b/docs/_posts/ahmedlone127/2024-08-22-arat5_spiderdataset_en.md new file mode 100644 index 00000000000000..ececa4d9c83168 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-arat5_spiderdataset_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arat5_spiderdataset T5Transformer from abdullahsn +author: John Snow Labs +name: arat5_spiderdataset +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_spiderdataset` is a English model originally trained by abdullahsn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_spiderdataset_en_5.4.2_3.0_1724309198488.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_spiderdataset_en_5.4.2_3.0_1724309198488.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arat5_spiderdataset","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arat5_spiderdataset", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_spiderdataset| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/abdullahsn/AraT5-SpiderDataset \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-arat5_spiderdataset_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-arat5_spiderdataset_pipeline_en.md new file mode 100644 index 00000000000000..81f2ce4db61690 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-arat5_spiderdataset_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arat5_spiderdataset_pipeline pipeline T5Transformer from abdullahsn +author: John Snow Labs +name: arat5_spiderdataset_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_spiderdataset_pipeline` is a English model originally trained by abdullahsn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_spiderdataset_pipeline_en_5.4.2_3.0_1724309286748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_spiderdataset_pipeline_en_5.4.2_3.0_1724309286748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arat5_spiderdataset_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arat5_spiderdataset_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_spiderdataset_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/abdullahsn/AraT5-SpiderDataset + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-arat5_xl_sum_version1_en.md b/docs/_posts/ahmedlone127/2024-08-22-arat5_xl_sum_version1_en.md new file mode 100644 index 00000000000000..28071854ea21f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-arat5_xl_sum_version1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English arat5_xl_sum_version1 T5Transformer from karim-Mohamed2018 +author: John Snow Labs +name: arat5_xl_sum_version1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_xl_sum_version1` is a English model originally trained by karim-Mohamed2018. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_xl_sum_version1_en_5.4.2_3.0_1724349507362.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_xl_sum_version1_en_5.4.2_3.0_1724349507362.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("arat5_xl_sum_version1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("arat5_xl_sum_version1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_xl_sum_version1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/karim-Mohamed2018/AraT5_XL-Sum_Version1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-arat5_xl_sum_version1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-arat5_xl_sum_version1_pipeline_en.md new file mode 100644 index 00000000000000..d68946cb4f049d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-arat5_xl_sum_version1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English arat5_xl_sum_version1_pipeline pipeline T5Transformer from karim-Mohamed2018 +author: John Snow Labs +name: arat5_xl_sum_version1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`arat5_xl_sum_version1_pipeline` is a English model originally trained by karim-Mohamed2018. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/arat5_xl_sum_version1_pipeline_en_5.4.2_3.0_1724349585099.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/arat5_xl_sum_version1_pipeline_en_5.4.2_3.0_1724349585099.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("arat5_xl_sum_version1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("arat5_xl_sum_version1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|arat5_xl_sum_version1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.7 GB| + +## References + +https://huggingface.co/karim-Mohamed2018/AraT5_XL-Sum_Version1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-asdfgh_en.md b/docs/_posts/ahmedlone127/2024-08-22-asdfgh_en.md new file mode 100644 index 00000000000000..ea663ac7a45317 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-asdfgh_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English asdfgh T5Transformer from Gunchar +author: John Snow Labs +name: asdfgh +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`asdfgh` is a English model originally trained by Gunchar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/asdfgh_en_5.4.2_3.0_1724333860159.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/asdfgh_en_5.4.2_3.0_1724333860159.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("asdfgh","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("asdfgh", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|asdfgh| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|284.2 MB| + +## References + +https://huggingface.co/Gunchar/asdfgh \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-asdfgh_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-asdfgh_pipeline_en.md new file mode 100644 index 00000000000000..7ef5574aa63135 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-asdfgh_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English asdfgh_pipeline pipeline T5Transformer from Gunchar +author: John Snow Labs +name: asdfgh_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`asdfgh_pipeline` is a English model originally trained by Gunchar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/asdfgh_pipeline_en_5.4.2_3.0_1724333887802.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/asdfgh_pipeline_en_5.4.2_3.0_1724333887802.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("asdfgh_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("asdfgh_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|asdfgh_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|284.2 MB| + +## References + +https://huggingface.co/Gunchar/asdfgh + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-asr_whisper_tiny_opt_xx.md b/docs/_posts/ahmedlone127/2024-08-22-asr_whisper_tiny_opt_xx.md new file mode 100644 index 00000000000000..06518b27068803 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-asr_whisper_tiny_opt_xx.md @@ -0,0 +1,111 @@ +--- +layout: model +title: Official whisper-tiny Optimized +author: John Snow Labs +name: asr_whisper_tiny_opt +date: 2024-08-22 +tags: [audio, asr, openvino, xx, open_source] +task: Automatic Speech Recognition +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: openvino +annotator: WhisperForCTC +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +“ +Official pretrained Whisper model, adapted from HuggingFace transformer and curated to provide scalability and production-readiness using Spark NLP. + +This is a multilingual model and supports the following languages: + +Afrikaans, Arabic, Armenian, Azerbaijani, Belarusian, Bosnian, Bulgarian, Catalan, Chinese, Croatian, Czech, Danish, Dutch, English, Estonian, Finnish, French, Galician, German, Greek, Hebrew, Hindi, Hungarian, Icelandic, Indonesian, Italian, Japanese, Kannada, Kazakh, Korean, Latvian, Lithuanian, Macedonian, Malay, Marathi, Maori, Nepali, Norwegian, Persian, Polish, Portuguese, Romanian, Russian, Serbian, Slovak, Slovenian, Spanish, Swahili, Swedish, Tagalog, Tamil, Thai, Turkish, Ukrainian, Urdu, Vietnamese, and Welsh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/asr_whisper_tiny_opt_xx_5.4.2_3.0_1724342417686.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/asr_whisper_tiny_opt_xx_5.4.2_3.0_1724342417686.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +import sparknlp +from sparknlp.base import * +from sparknlp.annotator import * +from pyspark.ml import Pipeline + +audioAssembler = AudioAssembler() \ + .setInputCol("audio_content") \ + .setOutputCol("audio_assembler") + +speechToText = WhisperForCTC.pretrained("asr_whisper_tiny_opt", "xx") \ + .setInputCols(["audio_assembler"]) \ + .setOutputCol("text") + +pipeline = Pipeline().setStages([audioAssembler, speechToText]) +processedAudioFloats = spark.createDataFrame([[rawFloats]]).toDF("audio_content") +result = pipeline.fit(processedAudioFloats).transform(processedAudioFloats) +result.select("text.result").show(truncate = False) + +``` +```scala + +import spark.implicits._ +import com.johnsnowlabs.nlp.base._ +import com.johnsnowlabs.nlp.annotators._ +import com.johnsnowlabs.nlp.annotators.audio.WhisperForCTC +import org.apache.spark.ml.Pipeline + +val audioAssembler: AudioAssembler = new AudioAssembler() + .setInputCol("audio_content") + .setOutputCol("audio_assembler") + +val speechToText: WhisperForCTC = WhisperForCTC + .pretrained("asr_whisper_tiny_opt", "xx") + .setInputCols("audio_assembler") + .setOutputCol("text") + +val pipeline: Pipeline = new Pipeline().setStages(Array(audioAssembler, speechToText)) + +val bufferedSource = + scala.io.Source.fromFile("src/test/resources/audio/txt/librispeech_asr_0.txt") + +val rawFloats = bufferedSource + .getLines() + .map(_.split(",").head.trim.toFloat) + .toArray +bufferedSource.close + +val processedAudioFloats = Seq(rawFloats).toDF("audio_content") + +val result = pipeline.fit(processedAudioFloats).transform(processedAudioFloats) +result.select("text.result").show(truncate = false) + + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|asr_whisper_tiny_opt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[audio_assembler]| +|Output Labels:|[document]| +|Language:|xx| +|Size:|156.5 MB| \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md new file mode 100644 index 00000000000000..056c6f65a53937 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_nodes_normal_graphs_without_edge_document_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_normal_graphs_without_edge_document_level_t5_run2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_normal_graphs_without_edge_document_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724353211287.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_en_5.4.2_3.0_1724353211287.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_nodes_normal_graphs_without_edge_document_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_nodes_normal_graphs_without_edge_document_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_normal_graphs_without_edge_document_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_normal_graphs_without_edge_document_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..750b43ffbc23f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724353233335.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline_en_5.4.2_3.0_1724353233335.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_normal_graphs_without_edge_document_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_normal_graphs_without_edge_document_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en.md new file mode 100644 index 00000000000000..3231f1914536ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en_5.4.2_3.0_1724346465356.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en_5.4.2_3.0_1724346465356.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.5 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_shuffled_graphs_with_edge_document_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..e9453e960feec1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724346487279.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724346487279.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|augmented_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.5 MB| + +## References + +https://huggingface.co/sheoran95/augmented_nodes_shuffled_graphs_with_edge_document_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-autotrain_create_question_model_708521506_en.md b/docs/_posts/ahmedlone127/2024-08-22-autotrain_create_question_model_708521506_en.md new file mode 100644 index 00000000000000..c155173bde0215 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-autotrain_create_question_model_708521506_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English autotrain_create_question_model_708521506 T5Transformer from unjustify +author: John Snow Labs +name: autotrain_create_question_model_708521506 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_create_question_model_708521506` is a English model originally trained by unjustify. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_create_question_model_708521506_en_5.4.2_3.0_1724358000712.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_create_question_model_708521506_en_5.4.2_3.0_1724358000712.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("autotrain_create_question_model_708521506","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("autotrain_create_question_model_708521506", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_create_question_model_708521506| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/unjustify/autotrain-Create_Question_Model-708521506 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-autotrain_create_question_model_708521506_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-autotrain_create_question_model_708521506_pipeline_en.md new file mode 100644 index 00000000000000..f90f75b51c08a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-autotrain_create_question_model_708521506_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English autotrain_create_question_model_708521506_pipeline pipeline T5Transformer from unjustify +author: John Snow Labs +name: autotrain_create_question_model_708521506_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`autotrain_create_question_model_708521506_pipeline` is a English model originally trained by unjustify. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/autotrain_create_question_model_708521506_pipeline_en_5.4.2_3.0_1724358146557.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/autotrain_create_question_model_708521506_pipeline_en_5.4.2_3.0_1724358146557.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("autotrain_create_question_model_708521506_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("autotrain_create_question_model_708521506_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|autotrain_create_question_model_708521506_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/unjustify/autotrain-Create_Question_Model-708521506 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-balanced_test_en.md b/docs/_posts/ahmedlone127/2024-08-22-balanced_test_en.md new file mode 100644 index 00000000000000..9391f50efbef1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-balanced_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English balanced_test T5Transformer from ahsan-mavros +author: John Snow Labs +name: balanced_test +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`balanced_test` is a English model originally trained by ahsan-mavros. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/balanced_test_en_5.4.2_3.0_1724366046770.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/balanced_test_en_5.4.2_3.0_1724366046770.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("balanced_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("balanced_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|balanced_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ahsan-mavros/balanced-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-balanced_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-balanced_test_pipeline_en.md new file mode 100644 index 00000000000000..2b017d92bf71f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-balanced_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English balanced_test_pipeline pipeline T5Transformer from ahsan-mavros +author: John Snow Labs +name: balanced_test_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`balanced_test_pipeline` is a English model originally trained by ahsan-mavros. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/balanced_test_pipeline_en_5.4.2_3.0_1724366094624.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/balanced_test_pipeline_en_5.4.2_3.0_1724366094624.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("balanced_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("balanced_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|balanced_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ahsan-mavros/balanced-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bangla_idiom_paraphrase_v1_hmehrab_en.md b/docs/_posts/ahmedlone127/2024-08-22-bangla_idiom_paraphrase_v1_hmehrab_en.md new file mode 100644 index 00000000000000..6326470ad7d634 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bangla_idiom_paraphrase_v1_hmehrab_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_idiom_paraphrase_v1_hmehrab T5Transformer from HMehrab +author: John Snow Labs +name: bangla_idiom_paraphrase_v1_hmehrab +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_idiom_paraphrase_v1_hmehrab` is a English model originally trained by HMehrab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_idiom_paraphrase_v1_hmehrab_en_5.4.2_3.0_1724347877735.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_idiom_paraphrase_v1_hmehrab_en_5.4.2_3.0_1724347877735.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_idiom_paraphrase_v1_hmehrab","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_idiom_paraphrase_v1_hmehrab", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_idiom_paraphrase_v1_hmehrab| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/HMehrab/bangla_idiom_paraphrase_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bangla_idiom_paraphrase_v1_hmehrab_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-bangla_idiom_paraphrase_v1_hmehrab_pipeline_en.md new file mode 100644 index 00000000000000..5ec5c624f81630 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bangla_idiom_paraphrase_v1_hmehrab_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_idiom_paraphrase_v1_hmehrab_pipeline pipeline T5Transformer from HMehrab +author: John Snow Labs +name: bangla_idiom_paraphrase_v1_hmehrab_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_idiom_paraphrase_v1_hmehrab_pipeline` is a English model originally trained by HMehrab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_idiom_paraphrase_v1_hmehrab_pipeline_en_5.4.2_3.0_1724347924426.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_idiom_paraphrase_v1_hmehrab_pipeline_en_5.4.2_3.0_1724347924426.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_idiom_paraphrase_v1_hmehrab_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_idiom_paraphrase_v1_hmehrab_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_idiom_paraphrase_v1_hmehrab_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/HMehrab/bangla_idiom_paraphrase_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_150000_en.md b/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_150000_en.md new file mode 100644 index 00000000000000..a6fd959c6147e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_150000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_para_v3_150000 T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_150000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_150000` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_150000_en_5.4.2_3.0_1724333235316.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_150000_en_5.4.2_3.0_1724333235316.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_para_v3_150000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_para_v3_150000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_150000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-150000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_150000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_150000_pipeline_en.md new file mode 100644 index 00000000000000..3f652f71abc0d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_150000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_para_v3_150000_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_150000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_150000_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_150000_pipeline_en_5.4.2_3.0_1724333280923.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_150000_pipeline_en_5.4.2_3.0_1724333280923.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_para_v3_150000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_para_v3_150000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_150000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-150000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_90000_en.md b/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_90000_en.md new file mode 100644 index 00000000000000..c1fd0ebcd8b094 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_para_v3_90000 T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_90000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_90000` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_90000_en_5.4.2_3.0_1724354169901.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_90000_en_5.4.2_3.0_1724354169901.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_para_v3_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_para_v3_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_90000_pipeline_en.md new file mode 100644 index 00000000000000..ba476fd82bb396 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bangla_para_v3_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_para_v3_90000_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_90000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_90000_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_90000_pipeline_en_5.4.2_3.0_1724354216264.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_90000_pipeline_en_5.4.2_3.0_1724354216264.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_para_v3_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_para_v3_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bart_base_qds_en.md b/docs/_posts/ahmedlone127/2024-08-22-bart_base_qds_en.md new file mode 100644 index 00000000000000..9c16592922c5ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bart_base_qds_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bart_base_qds T5Transformer from dtruong46me +author: John Snow Labs +name: bart_base_qds +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bart_base_qds` is a English model originally trained by dtruong46me. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bart_base_qds_en_5.4.2_3.0_1724327885750.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bart_base_qds_en_5.4.2_3.0_1724327885750.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bart_base_qds","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bart_base_qds", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bart_base_qds| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/dtruong46me/bart-base-qds \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bart_base_qds_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-bart_base_qds_pipeline_en.md new file mode 100644 index 00000000000000..7fcb78e32dc947 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bart_base_qds_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bart_base_qds_pipeline pipeline T5Transformer from dtruong46me +author: John Snow Labs +name: bart_base_qds_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bart_base_qds_pipeline` is a English model originally trained by dtruong46me. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bart_base_qds_pipeline_en_5.4.2_3.0_1724327904208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bart_base_qds_pipeline_en_5.4.2_3.0_1724327904208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bart_base_qds_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bart_base_qds_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bart_base_qds_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/dtruong46me/bart-base-qds + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bdp_summarization_t8_en.md b/docs/_posts/ahmedlone127/2024-08-22-bdp_summarization_t8_en.md new file mode 100644 index 00000000000000..b811716be97723 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bdp_summarization_t8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bdp_summarization_t8 T5Transformer from DamianoDiPaola +author: John Snow Labs +name: bdp_summarization_t8 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bdp_summarization_t8` is a English model originally trained by DamianoDiPaola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bdp_summarization_t8_en_5.4.2_3.0_1724307140769.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bdp_summarization_t8_en_5.4.2_3.0_1724307140769.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bdp_summarization_t8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bdp_summarization_t8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bdp_summarization_t8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.7 MB| + +## References + +https://huggingface.co/DamianoDiPaola/bdp_summarization_T8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bdp_summarization_t8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-bdp_summarization_t8_pipeline_en.md new file mode 100644 index 00000000000000..f8b1e16e4a1894 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bdp_summarization_t8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bdp_summarization_t8_pipeline pipeline T5Transformer from DamianoDiPaola +author: John Snow Labs +name: bdp_summarization_t8_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bdp_summarization_t8_pipeline` is a English model originally trained by DamianoDiPaola. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bdp_summarization_t8_pipeline_en_5.4.2_3.0_1724307158293.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bdp_summarization_t8_pipeline_en_5.4.2_3.0_1724307158293.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bdp_summarization_t8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bdp_summarization_t8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bdp_summarization_t8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.7 MB| + +## References + +https://huggingface.co/DamianoDiPaola/bdp_summarization_T8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bikes_select_t5_small_0_en.md b/docs/_posts/ahmedlone127/2024-08-22-bikes_select_t5_small_0_en.md new file mode 100644 index 00000000000000..8e82c400319c16 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bikes_select_t5_small_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bikes_select_t5_small_0 T5Transformer from neal61 +author: John Snow Labs +name: bikes_select_t5_small_0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bikes_select_t5_small_0` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bikes_select_t5_small_0_en_5.4.2_3.0_1724354181142.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bikes_select_t5_small_0_en_5.4.2_3.0_1724354181142.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bikes_select_t5_small_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bikes_select_t5_small_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bikes_select_t5_small_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/neal61/bikes-select-t5-small-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bikes_select_t5_small_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-bikes_select_t5_small_0_pipeline_en.md new file mode 100644 index 00000000000000..e882fa550bf710 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bikes_select_t5_small_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bikes_select_t5_small_0_pipeline pipeline T5Transformer from neal61 +author: John Snow Labs +name: bikes_select_t5_small_0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bikes_select_t5_small_0_pipeline` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bikes_select_t5_small_0_pipeline_en_5.4.2_3.0_1724354198569.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bikes_select_t5_small_0_pipeline_en_5.4.2_3.0_1724354198569.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bikes_select_t5_small_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bikes_select_t5_small_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bikes_select_t5_small_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.7 MB| + +## References + +https://huggingface.co/neal61/bikes-select-t5-small-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-billsum_236_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-22-billsum_236_t5_base_en.md new file mode 100644 index 00000000000000..0518bd4aea57cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-billsum_236_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English billsum_236_t5_base T5Transformer from ryusangwon +author: John Snow Labs +name: billsum_236_t5_base +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`billsum_236_t5_base` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/billsum_236_t5_base_en_5.4.2_3.0_1724370082657.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/billsum_236_t5_base_en_5.4.2_3.0_1724370082657.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("billsum_236_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("billsum_236_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|billsum_236_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ryusangwon/billsum_236_t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-billsum_236_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-billsum_236_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..c1ef3b14244122 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-billsum_236_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English billsum_236_t5_base_pipeline pipeline T5Transformer from ryusangwon +author: John Snow Labs +name: billsum_236_t5_base_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`billsum_236_t5_base_pipeline` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/billsum_236_t5_base_pipeline_en_5.4.2_3.0_1724370132230.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/billsum_236_t5_base_pipeline_en_5.4.2_3.0_1724370132230.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("billsum_236_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("billsum_236_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|billsum_236_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ryusangwon/billsum_236_t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_dannyp0_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_dannyp0_en.md new file mode 100644 index 00000000000000..f53768bf4c8e5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_dannyp0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_dannyp0 T5Transformer from Dannyp0 +author: John Snow Labs +name: burmese_awesome_billsum_model_dannyp0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_dannyp0` is a English model originally trained by Dannyp0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_dannyp0_en_5.4.2_3.0_1724316624764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_dannyp0_en_5.4.2_3.0_1724316624764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_dannyp0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_dannyp0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_dannyp0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|271.6 MB| + +## References + +https://huggingface.co/Dannyp0/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_dannyp0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_dannyp0_pipeline_en.md new file mode 100644 index 00000000000000..eac6151a6adfae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_dannyp0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_dannyp0_pipeline pipeline T5Transformer from Dannyp0 +author: John Snow Labs +name: burmese_awesome_billsum_model_dannyp0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_dannyp0_pipeline` is a English model originally trained by Dannyp0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_dannyp0_pipeline_en_5.4.2_3.0_1724316654614.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_dannyp0_pipeline_en_5.4.2_3.0_1724316654614.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_dannyp0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_dannyp0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_dannyp0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|271.6 MB| + +## References + +https://huggingface.co/Dannyp0/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_katik0_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_katik0_en.md new file mode 100644 index 00000000000000..60d83920cc511a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_katik0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_katik0 T5Transformer from katik0 +author: John Snow Labs +name: burmese_awesome_billsum_model_katik0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_katik0` is a English model originally trained by katik0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_katik0_en_5.4.2_3.0_1724333615642.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_katik0_en_5.4.2_3.0_1724333615642.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_katik0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_katik0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_katik0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/katik0/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_katik0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_katik0_pipeline_en.md new file mode 100644 index 00000000000000..e070dc421511b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_katik0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_katik0_pipeline pipeline T5Transformer from katik0 +author: John Snow Labs +name: burmese_awesome_billsum_model_katik0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_katik0_pipeline` is a English model originally trained by katik0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_katik0_pipeline_en_5.4.2_3.0_1724333638602.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_katik0_pipeline_en_5.4.2_3.0_1724333638602.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_katik0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_katik0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_katik0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/katik0/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_mnnit_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_mnnit_en.md new file mode 100644 index 00000000000000..d5a18670d5058d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_mnnit_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_mnnit T5Transformer from mnnit +author: John Snow Labs +name: burmese_awesome_billsum_model_mnnit +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_mnnit` is a English model originally trained by mnnit. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_mnnit_en_5.4.2_3.0_1724364046514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_mnnit_en_5.4.2_3.0_1724364046514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_mnnit","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_mnnit", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_mnnit| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/mnnit/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_mnnit_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_mnnit_pipeline_en.md new file mode 100644 index 00000000000000..3b89feaefff405 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_mnnit_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_mnnit_pipeline pipeline T5Transformer from mnnit +author: John Snow Labs +name: burmese_awesome_billsum_model_mnnit_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_mnnit_pipeline` is a English model originally trained by mnnit. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_mnnit_pipeline_en_5.4.2_3.0_1724364068612.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_mnnit_pipeline_en_5.4.2_3.0_1724364068612.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_mnnit_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_mnnit_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_mnnit_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/mnnit/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_thebug95_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_thebug95_en.md new file mode 100644 index 00000000000000..acc66646046563 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_thebug95_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_thebug95 T5Transformer from TheBug95 +author: John Snow Labs +name: burmese_awesome_billsum_model_thebug95 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_thebug95` is a English model originally trained by TheBug95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_thebug95_en_5.4.2_3.0_1724310943617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_thebug95_en_5.4.2_3.0_1724310943617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_thebug95","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_thebug95", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_thebug95| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/TheBug95/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_thebug95_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_thebug95_pipeline_en.md new file mode 100644 index 00000000000000..e3105e8e31b21f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_thebug95_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_thebug95_pipeline pipeline T5Transformer from TheBug95 +author: John Snow Labs +name: burmese_awesome_billsum_model_thebug95_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_thebug95_pipeline` is a English model originally trained by TheBug95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_thebug95_pipeline_en_5.4.2_3.0_1724310965240.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_thebug95_pipeline_en_5.4.2_3.0_1724310965240.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_thebug95_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_thebug95_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_thebug95_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.2 MB| + +## References + +https://huggingface.co/TheBug95/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_tmnam20_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_tmnam20_en.md new file mode 100644 index 00000000000000..8be5ce4b140413 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_tmnam20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_tmnam20 T5Transformer from tmnam20 +author: John Snow Labs +name: burmese_awesome_billsum_model_tmnam20 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_tmnam20` is a English model originally trained by tmnam20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_tmnam20_en_5.4.2_3.0_1724286448578.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_tmnam20_en_5.4.2_3.0_1724286448578.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_tmnam20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_tmnam20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_tmnam20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/tmnam20/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_tmnam20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_tmnam20_pipeline_en.md new file mode 100644 index 00000000000000..9dffbc456a63ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_billsum_model_tmnam20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_tmnam20_pipeline pipeline T5Transformer from tmnam20 +author: John Snow Labs +name: burmese_awesome_billsum_model_tmnam20_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_tmnam20_pipeline` is a English model originally trained by tmnam20. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_tmnam20_pipeline_en_5.4.2_3.0_1724286470896.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_tmnam20_pipeline_en_5.4.2_3.0_1724286470896.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_tmnam20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_tmnam20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_tmnam20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/tmnam20/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_model_omarharoon01_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_model_omarharoon01_en.md new file mode 100644 index 00000000000000..1bafac9fab7ae0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_model_omarharoon01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_model_omarharoon01 T5Transformer from OmarHaroon01 +author: John Snow Labs +name: burmese_awesome_model_omarharoon01 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_model_omarharoon01` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_omarharoon01_en_5.4.2_3.0_1724305134664.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_omarharoon01_en_5.4.2_3.0_1724305134664.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_model_omarharoon01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_model_omarharoon01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_model_omarharoon01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/OmarHaroon01/my-awesome-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_model_omarharoon01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_model_omarharoon01_pipeline_en.md new file mode 100644 index 00000000000000..c164f53ef434b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_model_omarharoon01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_model_omarharoon01_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: burmese_awesome_model_omarharoon01_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_model_omarharoon01_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_omarharoon01_pipeline_en_5.4.2_3.0_1724305151121.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_model_omarharoon01_pipeline_en_5.4.2_3.0_1724305151121.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_model_omarharoon01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_model_omarharoon01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_model_omarharoon01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/OmarHaroon01/my-awesome-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_kmok1_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_kmok1_en.md new file mode 100644 index 00000000000000..8270d18884f44c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_kmok1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_kmok1 T5Transformer from kmok1 +author: John Snow Labs +name: burmese_awesome_opus_books_model_kmok1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_kmok1` is a English model originally trained by kmok1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_kmok1_en_5.4.2_3.0_1724329306517.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_kmok1_en_5.4.2_3.0_1724329306517.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_kmok1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_kmok1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_kmok1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/kmok1/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_kmok1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_kmok1_pipeline_en.md new file mode 100644 index 00000000000000..9cb9fdca672590 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_kmok1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_kmok1_pipeline pipeline T5Transformer from kmok1 +author: John Snow Labs +name: burmese_awesome_opus_books_model_kmok1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_kmok1_pipeline` is a English model originally trained by kmok1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_kmok1_pipeline_en_5.4.2_3.0_1724329325900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_kmok1_pipeline_en_5.4.2_3.0_1724329325900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_kmok1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_kmok1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_kmok1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/kmok1/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_mrbean123_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_mrbean123_en.md new file mode 100644 index 00000000000000..b7a6961038a2cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_mrbean123_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_mrbean123 T5Transformer from MrBean123 +author: John Snow Labs +name: burmese_awesome_opus_books_model_mrbean123 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_mrbean123` is a English model originally trained by MrBean123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mrbean123_en_5.4.2_3.0_1724326930635.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mrbean123_en_5.4.2_3.0_1724326930635.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_mrbean123","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_mrbean123", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_mrbean123| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.6 MB| + +## References + +https://huggingface.co/MrBean123/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_mrbean123_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_mrbean123_pipeline_en.md new file mode 100644 index 00000000000000..4f0918f64f4b74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_mrbean123_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_mrbean123_pipeline pipeline T5Transformer from MrBean123 +author: John Snow Labs +name: burmese_awesome_opus_books_model_mrbean123_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_mrbean123_pipeline` is a English model originally trained by MrBean123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mrbean123_pipeline_en_5.4.2_3.0_1724326948900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_mrbean123_pipeline_en_5.4.2_3.0_1724326948900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_mrbean123_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_mrbean123_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_mrbean123_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.6 MB| + +## References + +https://huggingface.co/MrBean123/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_yjl814_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_yjl814_en.md new file mode 100644 index 00000000000000..6855099cb0b7b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_yjl814_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_yjl814 T5Transformer from YJL814 +author: John Snow Labs +name: burmese_awesome_opus_books_model_yjl814 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_yjl814` is a English model originally trained by YJL814. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_yjl814_en_5.4.2_3.0_1724337788258.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_yjl814_en_5.4.2_3.0_1724337788258.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_yjl814","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_yjl814", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_yjl814| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/YJL814/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_yjl814_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_yjl814_pipeline_en.md new file mode 100644 index 00000000000000..bb8f126643a329 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_awesome_opus_books_model_yjl814_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_yjl814_pipeline pipeline T5Transformer from YJL814 +author: John Snow Labs +name: burmese_awesome_opus_books_model_yjl814_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_yjl814_pipeline` is a English model originally trained by YJL814. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_yjl814_pipeline_en_5.4.2_3.0_1724337807555.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_yjl814_pipeline_en_5.4.2_3.0_1724337807555.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_yjl814_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_yjl814_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_yjl814_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/YJL814/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_upgrade_sentences_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_upgrade_sentences_v2_en.md new file mode 100644 index 00000000000000..bc633f0853243a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_upgrade_sentences_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_upgrade_sentences_v2 T5Transformer from duwuonline +author: John Snow Labs +name: burmese_upgrade_sentences_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_upgrade_sentences_v2` is a English model originally trained by duwuonline. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_upgrade_sentences_v2_en_5.4.2_3.0_1724286282384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_upgrade_sentences_v2_en_5.4.2_3.0_1724286282384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_upgrade_sentences_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_upgrade_sentences_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_upgrade_sentences_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/duwuonline/my-upgrade-sentences_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-burmese_upgrade_sentences_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-burmese_upgrade_sentences_v2_pipeline_en.md new file mode 100644 index 00000000000000..f48f2acad80442 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-burmese_upgrade_sentences_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_upgrade_sentences_v2_pipeline pipeline T5Transformer from duwuonline +author: John Snow Labs +name: burmese_upgrade_sentences_v2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_upgrade_sentences_v2_pipeline` is a English model originally trained by duwuonline. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_upgrade_sentences_v2_pipeline_en_5.4.2_3.0_1724286328761.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_upgrade_sentences_v2_pipeline_en_5.4.2_3.0_1724286328761.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_upgrade_sentences_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_upgrade_sentences_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_upgrade_sentences_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/duwuonline/my-upgrade-sentences_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bw58_billsum_model_en.md b/docs/_posts/ahmedlone127/2024-08-22-bw58_billsum_model_en.md new file mode 100644 index 00000000000000..ffa2ad9308e1f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bw58_billsum_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bw58_billsum_model T5Transformer from bw58 +author: John Snow Labs +name: bw58_billsum_model +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bw58_billsum_model` is a English model originally trained by bw58. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bw58_billsum_model_en_5.4.2_3.0_1724323293782.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bw58_billsum_model_en_5.4.2_3.0_1724323293782.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bw58_billsum_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bw58_billsum_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bw58_billsum_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/bw58/bw58_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-bw58_billsum_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-bw58_billsum_model_pipeline_en.md new file mode 100644 index 00000000000000..91e45ce26b9af5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-bw58_billsum_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bw58_billsum_model_pipeline pipeline T5Transformer from bw58 +author: John Snow Labs +name: bw58_billsum_model_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bw58_billsum_model_pipeline` is a English model originally trained by bw58. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bw58_billsum_model_pipeline_en_5.4.2_3.0_1724323309966.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bw58_billsum_model_pipeline_en_5.4.2_3.0_1724323309966.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bw58_billsum_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bw58_billsum_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bw58_billsum_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/bw58/bw58_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cat5_base_raw_en.md b/docs/_posts/ahmedlone127/2024-08-22-cat5_base_raw_en.md new file mode 100644 index 00000000000000..1c1cc9d8f73548 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cat5_base_raw_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cat5_base_raw T5Transformer from oooriii +author: John Snow Labs +name: cat5_base_raw +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cat5_base_raw` is a English model originally trained by oooriii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cat5_base_raw_en_5.4.2_3.0_1724307521605.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cat5_base_raw_en_5.4.2_3.0_1724307521605.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cat5_base_raw","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cat5_base_raw", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cat5_base_raw| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|511.6 MB| + +## References + +https://huggingface.co/oooriii/cat5-base-raw \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cat5_base_raw_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cat5_base_raw_pipeline_en.md new file mode 100644 index 00000000000000..33b35e6146015d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cat5_base_raw_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cat5_base_raw_pipeline pipeline T5Transformer from oooriii +author: John Snow Labs +name: cat5_base_raw_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cat5_base_raw_pipeline` is a English model originally trained by oooriii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cat5_base_raw_pipeline_en_5.4.2_3.0_1724307696302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cat5_base_raw_pipeline_en_5.4.2_3.0_1724307696302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cat5_base_raw_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cat5_base_raw_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cat5_base_raw_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|511.6 MB| + +## References + +https://huggingface.co/oooriii/cat5-base-raw + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cat_sum_iw_en.md b/docs/_posts/ahmedlone127/2024-08-22-cat_sum_iw_en.md new file mode 100644 index 00000000000000..4fc88eb5cf2395 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cat_sum_iw_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cat_sum_iw T5Transformer from homersimpson +author: John Snow Labs +name: cat_sum_iw +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cat_sum_iw` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cat_sum_iw_en_5.4.2_3.0_1724316812425.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cat_sum_iw_en_5.4.2_3.0_1724316812425.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cat_sum_iw","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cat_sum_iw", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cat_sum_iw| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/homersimpson/cat-sum-iw \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cat_sum_iw_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cat_sum_iw_pipeline_en.md new file mode 100644 index 00000000000000..a49bf13d919493 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cat_sum_iw_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cat_sum_iw_pipeline pipeline T5Transformer from homersimpson +author: John Snow Labs +name: cat_sum_iw_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cat_sum_iw_pipeline` is a English model originally trained by homersimpson. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cat_sum_iw_pipeline_en_5.4.2_3.0_1724316874546.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cat_sum_iw_pipeline_en_5.4.2_3.0_1724316874546.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cat_sum_iw_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cat_sum_iw_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cat_sum_iw_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/homersimpson/cat-sum-iw + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-chatsum_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-chatsum_small_en.md new file mode 100644 index 00000000000000..fb8e95f22d98fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-chatsum_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English chatsum_small T5Transformer from KoalaAI +author: John Snow Labs +name: chatsum_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chatsum_small` is a English model originally trained by KoalaAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chatsum_small_en_5.4.2_3.0_1724301229426.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chatsum_small_en_5.4.2_3.0_1724301229426.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("chatsum_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("chatsum_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chatsum_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/KoalaAI/ChatSum-Small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-chatsum_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-chatsum_small_pipeline_en.md new file mode 100644 index 00000000000000..f89e8b8255b7d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-chatsum_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English chatsum_small_pipeline pipeline T5Transformer from KoalaAI +author: John Snow Labs +name: chatsum_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`chatsum_small_pipeline` is a English model originally trained by KoalaAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/chatsum_small_pipeline_en_5.4.2_3.0_1724301246853.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/chatsum_small_pipeline_en_5.4.2_3.0_1724301246853.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("chatsum_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("chatsum_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|chatsum_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/KoalaAI/ChatSum-Small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-checkmate_gec_en.md b/docs/_posts/ahmedlone127/2024-08-22-checkmate_gec_en.md new file mode 100644 index 00000000000000..ce2ff99d0dc247 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-checkmate_gec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English checkmate_gec T5Transformer from asimokby +author: John Snow Labs +name: checkmate_gec +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`checkmate_gec` is a English model originally trained by asimokby. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/checkmate_gec_en_5.4.2_3.0_1724295702686.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/checkmate_gec_en_5.4.2_3.0_1724295702686.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("checkmate_gec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("checkmate_gec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|checkmate_gec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/asimokby/checkMate-gec \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-checkmate_gec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-checkmate_gec_pipeline_en.md new file mode 100644 index 00000000000000..41e2cbd67458c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-checkmate_gec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English checkmate_gec_pipeline pipeline T5Transformer from asimokby +author: John Snow Labs +name: checkmate_gec_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`checkmate_gec_pipeline` is a English model originally trained by asimokby. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/checkmate_gec_pipeline_en_5.4.2_3.0_1724295752289.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/checkmate_gec_pipeline_en_5.4.2_3.0_1724295752289.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("checkmate_gec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("checkmate_gec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|checkmate_gec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/asimokby/checkMate-gec + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-checkpoint_en.md b/docs/_posts/ahmedlone127/2024-08-22-checkpoint_en.md new file mode 100644 index 00000000000000..da996feaa2196c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-checkpoint_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English checkpoint T5Transformer from AnonymousSubmissionOnly +author: John Snow Labs +name: checkpoint +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`checkpoint` is a English model originally trained by AnonymousSubmissionOnly. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/checkpoint_en_5.4.2_3.0_1724307533726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/checkpoint_en_5.4.2_3.0_1724307533726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("checkpoint","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("checkpoint", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|checkpoint| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousSubmissionOnly/checkpoint \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-checkpoint_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-checkpoint_pipeline_en.md new file mode 100644 index 00000000000000..64ce78f377dab4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-checkpoint_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English checkpoint_pipeline pipeline T5Transformer from AnonymousSubmissionOnly +author: John Snow Labs +name: checkpoint_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`checkpoint_pipeline` is a English model originally trained by AnonymousSubmissionOnly. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/checkpoint_pipeline_en_5.4.2_3.0_1724307583502.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/checkpoint_pipeline_en_5.4.2_3.0_1724307583502.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("checkpoint_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("checkpoint_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|checkpoint_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/AnonymousSubmissionOnly/checkpoint + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-code_mixed_banglish_english_4_en.md b/docs/_posts/ahmedlone127/2024-08-22-code_mixed_banglish_english_4_en.md new file mode 100644 index 00000000000000..4720150bb4383e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-code_mixed_banglish_english_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English code_mixed_banglish_english_4 T5Transformer from Ayon128 +author: John Snow Labs +name: code_mixed_banglish_english_4 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`code_mixed_banglish_english_4` is a English model originally trained by Ayon128. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/code_mixed_banglish_english_4_en_5.4.2_3.0_1724323058756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/code_mixed_banglish_english_4_en_5.4.2_3.0_1724323058756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("code_mixed_banglish_english_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("code_mixed_banglish_english_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|code_mixed_banglish_english_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ayon128/code-mixed_Banglish_English_4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-code_mixed_banglish_english_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-code_mixed_banglish_english_4_pipeline_en.md new file mode 100644 index 00000000000000..a5ae82282198c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-code_mixed_banglish_english_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English code_mixed_banglish_english_4_pipeline pipeline T5Transformer from Ayon128 +author: John Snow Labs +name: code_mixed_banglish_english_4_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`code_mixed_banglish_english_4_pipeline` is a English model originally trained by Ayon128. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/code_mixed_banglish_english_4_pipeline_en_5.4.2_3.0_1724323105913.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/code_mixed_banglish_english_4_pipeline_en_5.4.2_3.0_1724323105913.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("code_mixed_banglish_english_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("code_mixed_banglish_english_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|code_mixed_banglish_english_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ayon128/code-mixed_Banglish_English_4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-continue_corrupt_grammar_model_wmt446_en.md b/docs/_posts/ahmedlone127/2024-08-22-continue_corrupt_grammar_model_wmt446_en.md new file mode 100644 index 00000000000000..ba59c9e622b451 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-continue_corrupt_grammar_model_wmt446_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English continue_corrupt_grammar_model_wmt446 T5Transformer from mika5883 +author: John Snow Labs +name: continue_corrupt_grammar_model_wmt446 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`continue_corrupt_grammar_model_wmt446` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/continue_corrupt_grammar_model_wmt446_en_5.4.2_3.0_1724371155870.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/continue_corrupt_grammar_model_wmt446_en_5.4.2_3.0_1724371155870.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("continue_corrupt_grammar_model_wmt446","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("continue_corrupt_grammar_model_wmt446", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|continue_corrupt_grammar_model_wmt446| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/continue_corrupt_grammar_model_wmt446 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cpt_kginfusedlm_ankush_c420_en.md b/docs/_posts/ahmedlone127/2024-08-22-cpt_kginfusedlm_ankush_c420_en.md new file mode 100644 index 00000000000000..3649909455a388 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cpt_kginfusedlm_ankush_c420_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cpt_kginfusedlm_ankush_c420 T5Transformer from sakharamg +author: John Snow Labs +name: cpt_kginfusedlm_ankush_c420 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cpt_kginfusedlm_ankush_c420` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cpt_kginfusedlm_ankush_c420_en_5.4.2_3.0_1724352008655.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cpt_kginfusedlm_ankush_c420_en_5.4.2_3.0_1724352008655.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cpt_kginfusedlm_ankush_c420","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cpt_kginfusedlm_ankush_c420", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cpt_kginfusedlm_ankush_c420| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPT_KGinfusedLM_ankush_c420 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cpt_kginfusedlm_ankush_c420_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cpt_kginfusedlm_ankush_c420_pipeline_en.md new file mode 100644 index 00000000000000..e3e762dec0ff57 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cpt_kginfusedlm_ankush_c420_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cpt_kginfusedlm_ankush_c420_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: cpt_kginfusedlm_ankush_c420_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cpt_kginfusedlm_ankush_c420_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cpt_kginfusedlm_ankush_c420_pipeline_en_5.4.2_3.0_1724352140811.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cpt_kginfusedlm_ankush_c420_pipeline_en_5.4.2_3.0_1724352140811.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cpt_kginfusedlm_ankush_c420_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cpt_kginfusedlm_ankush_c420_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cpt_kginfusedlm_ankush_c420_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPT_KGinfusedLM_ankush_c420 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cpt_t5_large_with_aviation_corpus_and_aviation_triples20_en.md b/docs/_posts/ahmedlone127/2024-08-22-cpt_t5_large_with_aviation_corpus_and_aviation_triples20_en.md new file mode 100644 index 00000000000000..93cc94d91b5946 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cpt_t5_large_with_aviation_corpus_and_aviation_triples20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cpt_t5_large_with_aviation_corpus_and_aviation_triples20 T5Transformer from sakharamg +author: John Snow Labs +name: cpt_t5_large_with_aviation_corpus_and_aviation_triples20 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cpt_t5_large_with_aviation_corpus_and_aviation_triples20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cpt_t5_large_with_aviation_corpus_and_aviation_triples20_en_5.4.2_3.0_1724311048981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cpt_t5_large_with_aviation_corpus_and_aviation_triples20_en_5.4.2_3.0_1724311048981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cpt_t5_large_with_aviation_corpus_and_aviation_triples20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cpt_t5_large_with_aviation_corpus_and_aviation_triples20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cpt_t5_large_with_aviation_corpus_and_aviation_triples20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPT_T5_large_with_aviation_corpus_and_aviation-triples20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline_en.md new file mode 100644 index 00000000000000..b5d851116b9ad5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline_en_5.4.2_3.0_1724311179885.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline_en_5.4.2_3.0_1724311179885.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cpt_t5_large_with_aviation_corpus_and_aviation_triples20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPT_T5_large_with_aviation_corpus_and_aviation-triples20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs341_camera_coqe_unicoqe_v4_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs341_camera_coqe_unicoqe_v4_en.md new file mode 100644 index 00000000000000..5638262ca8938c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs341_camera_coqe_unicoqe_v4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs341_camera_coqe_unicoqe_v4 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs341_camera_coqe_unicoqe_v4 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs341_camera_coqe_unicoqe_v4` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_v4_en_5.4.2_3.0_1724338774721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_v4_en_5.4.2_3.0_1724338774721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs341_camera_coqe_unicoqe_v4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs341_camera_coqe_unicoqe_v4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs341_camera_coqe_unicoqe_v4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS341_Camera-COQE_UniCOQE_v4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs341_camera_coqe_unicoqe_v4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs341_camera_coqe_unicoqe_v4_pipeline_en.md new file mode 100644 index 00000000000000..06eaca5b762779 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs341_camera_coqe_unicoqe_v4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs341_camera_coqe_unicoqe_v4_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs341_camera_coqe_unicoqe_v4_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs341_camera_coqe_unicoqe_v4_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_v4_pipeline_en_5.4.2_3.0_1724338824131.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_v4_pipeline_en_5.4.2_3.0_1724338824131.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs341_camera_coqe_unicoqe_v4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs341_camera_coqe_unicoqe_v4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs341_camera_coqe_unicoqe_v4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS341_Camera-COQE_UniCOQE_v4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs341_vietnamese_coqe_unicoqe_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs341_vietnamese_coqe_unicoqe_en.md new file mode 100644 index 00000000000000..86583fe3b2bddf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs341_vietnamese_coqe_unicoqe_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs341_vietnamese_coqe_unicoqe T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs341_vietnamese_coqe_unicoqe +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs341_vietnamese_coqe_unicoqe` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs341_vietnamese_coqe_unicoqe_en_5.4.2_3.0_1724300035696.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs341_vietnamese_coqe_unicoqe_en_5.4.2_3.0_1724300035696.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs341_vietnamese_coqe_unicoqe","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs341_vietnamese_coqe_unicoqe", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs341_vietnamese_coqe_unicoqe| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS341_Vi-COQE_UniCOQE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting10_aspol_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting10_aspol_v2_en.md new file mode 100644 index 00000000000000..4941f6b74f2147 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting10_aspol_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting10_aspol_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting10_aspol_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting10_aspol_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting10_aspol_v2_en_5.4.2_3.0_1724313084095.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting10_aspol_v2_en_5.4.2_3.0_1724313084095.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting10_aspol_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting10_aspol_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting10_aspol_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting10_ASPOL_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting10_aspol_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting10_aspol_v2_pipeline_en.md new file mode 100644 index 00000000000000..201131e9cc2225 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting10_aspol_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting10_aspol_v2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting10_aspol_v2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting10_aspol_v2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting10_aspol_v2_pipeline_en_5.4.2_3.0_1724313262145.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting10_aspol_v2_pipeline_en_5.4.2_3.0_1724313262145.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting10_aspol_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting10_aspol_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting10_aspol_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting10_ASPOL_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_aposl_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_aposl_en.md new file mode 100644 index 00000000000000..0e50fa98d0196d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_aposl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_aposl T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_aposl +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_aposl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aposl_en_5.4.2_3.0_1724319476228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aposl_en_5.4.2_3.0_1724319476228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_aposl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_aposl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_aposl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APOSL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_aposl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_aposl_pipeline_en.md new file mode 100644 index 00000000000000..c1b2b6cbcd7eca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_aposl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_aposl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_aposl_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_aposl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aposl_pipeline_en_5.4.2_3.0_1724319655306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_aposl_pipeline_en_5.4.2_3.0_1724319655306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_aposl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_aposl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_aposl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APOSL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_en.md new file mode 100644 index 00000000000000..ebb472a197fa04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_en_5.4.2_3.0_1724291047078.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_en_5.4.2_3.0_1724291047078.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_GPT_paraphrase_F1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline_en.md new file mode 100644 index 00000000000000..4e179910753c35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline_en_5.4.2_3.0_1724291217114.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline_en_5.4.2_3.0_1724291217114.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_gpt_paraphrase_f1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_GPT_paraphrase_F1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_en.md new file mode 100644 index 00000000000000..916e9ebeec719c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_en_5.4.2_3.0_1724359786702.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_en_5.4.2_3.0_1724359786702.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_label2text_AugAp2Filter3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline_en.md new file mode 100644 index 00000000000000..285cfa6e5ca81f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline_en_5.4.2_3.0_1724359956432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline_en_5.4.2_3.0_1724359956432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_label2text_augap2filter3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_label2text_AugAp2Filter3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_sup_aug1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_sup_aug1_en.md new file mode 100644 index 00000000000000..e4ed9cc3c3f7cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_apsol_sup_aug1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_apsol_sup_aug1 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_apsol_sup_aug1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_apsol_sup_aug1` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_sup_aug1_en_5.4.2_3.0_1724335005473.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_apsol_sup_aug1_en_5.4.2_3.0_1724335005473.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_sup_aug1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_apsol_sup_aug1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_apsol_sup_aug1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_APSOL_SUP_Aug1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_osapl_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_osapl_en.md new file mode 100644 index 00000000000000..366a4b210cdda0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_osapl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_osapl T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_osapl +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_osapl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_osapl_en_5.4.2_3.0_1724338310903.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_osapl_en_5.4.2_3.0_1724338310903.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_osapl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_osapl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_osapl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_OSAPL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_osapl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_osapl_pipeline_en.md new file mode 100644 index 00000000000000..dd008adb5fd695 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_osapl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_osapl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_osapl_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_osapl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_osapl_pipeline_en_5.4.2_3.0_1724338477223.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_osapl_pipeline_en_5.4.2_3.0_1724338477223.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_osapl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_osapl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_osapl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_OSAPL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_psaol_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_psaol_en.md new file mode 100644 index 00000000000000..081392ff6e9983 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_psaol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_psaol T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_psaol +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_psaol` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_psaol_en_5.4.2_3.0_1724329576826.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_psaol_en_5.4.2_3.0_1724329576826.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_psaol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_psaol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_psaol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_PSAOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_psaol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_psaol_pipeline_en.md new file mode 100644 index 00000000000000..06097885bfbb76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_prompting5_psaol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_psaol_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_psaol_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_psaol_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_psaol_pipeline_en_5.4.2_3.0_1724329749942.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_psaol_pipeline_en_5.4.2_3.0_1724329749942.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_psaol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_psaol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_psaol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_PSAOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_aposl_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_aposl_v1_h1_en.md new file mode 100644 index 00000000000000..41b298c527700b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_aposl_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_aposl_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_aposl_v1_h1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_aposl_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_aposl_v1_h1_en_5.4.2_3.0_1724342631437.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_aposl_v1_h1_en_5.4.2_3.0_1724342631437.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_aposl_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_aposl_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_aposl_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_APOSL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..153288eff95c46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline_en_5.4.2_3.0_1724342806053.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline_en_5.4.2_3.0_1724342806053.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_aposl_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_APOSL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_apsol_v1_h0_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_apsol_v1_h0_en.md new file mode 100644 index 00000000000000..7d3a1b63a20d81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_apsol_v1_h0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_apsol_v1_h0 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_apsol_v1_h0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_apsol_v1_h0` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_apsol_v1_h0_en_5.4.2_3.0_1724313569111.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_apsol_v1_h0_en_5.4.2_3.0_1724313569111.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_apsol_v1_h0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_apsol_v1_h0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_apsol_v1_h0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_APSOL_v1_h0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline_en.md new file mode 100644 index 00000000000000..6129ba3a6d3c93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline_en_5.4.2_3.0_1724313759122.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline_en_5.4.2_3.0_1724313759122.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_apsol_v1_h0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_APSOL_v1_h0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instructionn5_soapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instructionn5_soapl_v1_en.md new file mode 100644 index 00000000000000..3419e2d1821ee8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instructionn5_soapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instructionn5_soapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instructionn5_soapl_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instructionn5_soapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn5_soapl_v1_en_5.4.2_3.0_1724319101636.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn5_soapl_v1_en_5.4.2_3.0_1724319101636.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instructionn5_soapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instructionn5_soapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instructionn5_soapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_InstructionN5_SOAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline_en.md new file mode 100644 index 00000000000000..e174524b75f24c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline_en_5.4.2_3.0_1724319287106.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline_en_5.4.2_3.0_1724319287106.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instructionn5_soapl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_InstructionN5_SOAPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aopsl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aopsl_v1_en.md new file mode 100644 index 00000000000000..7f410eb32a3f37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aopsl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aopsl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aopsl_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aopsl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aopsl_v1_en_5.4.2_3.0_1724349220645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aopsl_v1_en_5.4.2_3.0_1724349220645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aopsl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aopsl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aopsl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_AOPSL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline_en.md new file mode 100644 index 00000000000000..63d7378c944d1a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline_en_5.4.2_3.0_1724349397181.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline_en_5.4.2_3.0_1724349397181.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aopsl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_AOPSL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aospl_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aospl_en.md new file mode 100644 index 00000000000000..3b00e09886937f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aospl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aospl T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aospl +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aospl` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aospl_en_5.4.2_3.0_1724357249040.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aospl_en_5.4.2_3.0_1724357249040.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aospl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aospl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aospl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_AOSPL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aospl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aospl_pipeline_en.md new file mode 100644 index 00000000000000..d6ccd807c40f1f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aospl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aospl_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aospl_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aospl_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aospl_pipeline_en_5.4.2_3.0_1724357431774.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aospl_pipeline_en_5.4.2_3.0_1724357431774.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aospl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aospl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aospl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_AOSPL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_apsol_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_apsol_en.md new file mode 100644 index 00000000000000..30d2e173876a9e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_apsol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_apsol T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_apsol +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_apsol` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_apsol_en_5.4.2_3.0_1724302637471.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_apsol_en_5.4.2_3.0_1724302637471.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_apsol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_apsol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_apsol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_APSOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_apsol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_apsol_v1_en.md new file mode 100644 index 00000000000000..dbe0ed65fec82b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_apsol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_apsol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_apsol_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_apsol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_apsol_v1_en_5.4.2_3.0_1724358832291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_apsol_v1_en_5.4.2_3.0_1724358832291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_apsol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_apsol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_apsol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_APSOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aspol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aspol_v1_en.md new file mode 100644 index 00000000000000..268ca29e0a7089 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aspol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aspol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aspol_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aspol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_v1_en_5.4.2_3.0_1724344430548.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_v1_en_5.4.2_3.0_1724344430548.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aspol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aspol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aspol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_ASPOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline_en.md new file mode 100644 index 00000000000000..4b8a84f47e099d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline_en_5.4.2_3.0_1724344618310.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline_en_5.4.2_3.0_1724344618310.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aspol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_ASPOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_saopl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_saopl_v1_en.md new file mode 100644 index 00000000000000..06679af6506224 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_saopl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_saopl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_saopl_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_saopl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_saopl_v1_en_5.4.2_3.0_1724346978979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_saopl_v1_en_5.4.2_3.0_1724346978979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_saopl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_saopl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_saopl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SAOPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline_en.md new file mode 100644 index 00000000000000..68f5647fed6b2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline_en_5.4.2_3.0_1724347163523.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline_en_5.4.2_3.0_1724347163523.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_saopl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SAOPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_soapl_h3_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_soapl_h3_en.md new file mode 100644 index 00000000000000..4f2f545b452cd7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_soapl_h3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_soapl_h3 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_soapl_h3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_soapl_h3` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_soapl_h3_en_5.4.2_3.0_1724317590370.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_soapl_h3_en_5.4.2_3.0_1724317590370.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_soapl_h3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_soapl_h3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_soapl_h3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SOAPL_h3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline_en.md new file mode 100644 index 00000000000000..21016f9ce291e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline_en_5.4.2_3.0_1724317763104.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline_en_5.4.2_3.0_1724317763104.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_soapl_h3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_SOAPL_h3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instructionn0_sapol_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instructionn0_sapol_v1_en.md new file mode 100644 index 00000000000000..c1fd341e128e65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instructionn0_sapol_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_sapol_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_sapol_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_sapol_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_sapol_v1_en_5.4.2_3.0_1724316453754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_sapol_v1_en_5.4.2_3.0_1724316453754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_sapol_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn0_sapol_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_sapol_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_SAPOL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline_en.md new file mode 100644 index 00000000000000..e84d097202fae9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline_en_5.4.2_3.0_1724316629502.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline_en_5.4.2_3.0_1724316629502.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn0_sapol_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN0_SAPOL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cst5_base_en.md b/docs/_posts/ahmedlone127/2024-08-22-cst5_base_en.md new file mode 100644 index 00000000000000..8d51235a3a52da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cst5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cst5_base T5Transformer from azizbarank +author: John Snow Labs +name: cst5_base +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cst5_base` is a English model originally trained by azizbarank. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cst5_base_en_5.4.2_3.0_1724303686420.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cst5_base_en_5.4.2_3.0_1724303686420.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cst5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cst5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cst5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|511.6 MB| + +## References + +https://huggingface.co/azizbarank/cst5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-cst5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-cst5_base_pipeline_en.md new file mode 100644 index 00000000000000..1ea1bc282dc33f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-cst5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cst5_base_pipeline pipeline T5Transformer from azizbarank +author: John Snow Labs +name: cst5_base_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cst5_base_pipeline` is a English model originally trained by azizbarank. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cst5_base_pipeline_en_5.4.2_3.0_1724303861189.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cst5_base_pipeline_en_5.4.2_3.0_1724303861189.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cst5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cst5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cst5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|511.6 MB| + +## References + +https://huggingface.co/azizbarank/cst5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-derm_t5_small_3_en.md b/docs/_posts/ahmedlone127/2024-08-22-derm_t5_small_3_en.md new file mode 100644 index 00000000000000..566839b0883e6f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-derm_t5_small_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English derm_t5_small_3 T5Transformer from neal61 +author: John Snow Labs +name: derm_t5_small_3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`derm_t5_small_3` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/derm_t5_small_3_en_5.4.2_3.0_1724328919392.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/derm_t5_small_3_en_5.4.2_3.0_1724328919392.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("derm_t5_small_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("derm_t5_small_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|derm_t5_small_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.5 MB| + +## References + +https://huggingface.co/neal61/derm-t5-small-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-derm_t5_small_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-derm_t5_small_3_pipeline_en.md new file mode 100644 index 00000000000000..6e5780f4c9b439 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-derm_t5_small_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English derm_t5_small_3_pipeline pipeline T5Transformer from neal61 +author: John Snow Labs +name: derm_t5_small_3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`derm_t5_small_3_pipeline` is a English model originally trained by neal61. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/derm_t5_small_3_pipeline_en_5.4.2_3.0_1724328936902.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/derm_t5_small_3_pipeline_en_5.4.2_3.0_1724328936902.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("derm_t5_small_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("derm_t5_small_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|derm_t5_small_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.5 MB| + +## References + +https://huggingface.co/neal61/derm-t5-small-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-desc_detoxify_sicon_en.md b/docs/_posts/ahmedlone127/2024-08-22-desc_detoxify_sicon_en.md new file mode 100644 index 00000000000000..62f1c979d01b16 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-desc_detoxify_sicon_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English desc_detoxify_sicon T5Transformer from infiniterik +author: John Snow Labs +name: desc_detoxify_sicon +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`desc_detoxify_sicon` is a English model originally trained by infiniterik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/desc_detoxify_sicon_en_5.4.2_3.0_1724285132143.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/desc_detoxify_sicon_en_5.4.2_3.0_1724285132143.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("desc_detoxify_sicon","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("desc_detoxify_sicon", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|desc_detoxify_sicon| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/infiniterik/desc-detoxify-sicon \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-desc_detoxify_sicon_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-desc_detoxify_sicon_pipeline_en.md new file mode 100644 index 00000000000000..7d23972b224f38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-desc_detoxify_sicon_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English desc_detoxify_sicon_pipeline pipeline T5Transformer from infiniterik +author: John Snow Labs +name: desc_detoxify_sicon_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`desc_detoxify_sicon_pipeline` is a English model originally trained by infiniterik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/desc_detoxify_sicon_pipeline_en_5.4.2_3.0_1724285267124.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/desc_detoxify_sicon_pipeline_en_5.4.2_3.0_1724285267124.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("desc_detoxify_sicon_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("desc_detoxify_sicon_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|desc_detoxify_sicon_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/infiniterik/desc-detoxify-sicon + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-dgslow_t5_small_ed_en.md b/docs/_posts/ahmedlone127/2024-08-22-dgslow_t5_small_ed_en.md new file mode 100644 index 00000000000000..678002798de33c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-dgslow_t5_small_ed_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dgslow_t5_small_ed T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_ed +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_ed` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_ed_en_5.4.2_3.0_1724301523305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_ed_en_5.4.2_3.0_1724301523305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dgslow_t5_small_ed","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dgslow_t5_small_ed", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_ed| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.6 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_ED \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-dgslow_t5_small_ed_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-dgslow_t5_small_ed_pipeline_en.md new file mode 100644 index 00000000000000..d0cc520e4a848f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-dgslow_t5_small_ed_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dgslow_t5_small_ed_pipeline pipeline T5Transformer from shenkha +author: John Snow Labs +name: dgslow_t5_small_ed_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dgslow_t5_small_ed_pipeline` is a English model originally trained by shenkha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_ed_pipeline_en_5.4.2_3.0_1724301544306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dgslow_t5_small_ed_pipeline_en_5.4.2_3.0_1724301544306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dgslow_t5_small_ed_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dgslow_t5_small_ed_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dgslow_t5_small_ed_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.6 MB| + +## References + +https://huggingface.co/shenkha/DGSlow_T5-small_ED + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-dialogsum_model_en.md b/docs/_posts/ahmedlone127/2024-08-22-dialogsum_model_en.md new file mode 100644 index 00000000000000..eb024f86b48f90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-dialogsum_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dialogsum_model T5Transformer from ShirinP +author: John Snow Labs +name: dialogsum_model +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogsum_model` is a English model originally trained by ShirinP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogsum_model_en_5.4.2_3.0_1724335289134.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogsum_model_en_5.4.2_3.0_1724335289134.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dialogsum_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dialogsum_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogsum_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.8 MB| + +## References + +https://huggingface.co/ShirinP/dialogsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-dialogsum_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-dialogsum_model_pipeline_en.md new file mode 100644 index 00000000000000..1e1d3b548a74b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-dialogsum_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dialogsum_model_pipeline pipeline T5Transformer from ShirinP +author: John Snow Labs +name: dialogsum_model_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dialogsum_model_pipeline` is a English model originally trained by ShirinP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dialogsum_model_pipeline_en_5.4.2_3.0_1724335308780.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dialogsum_model_pipeline_en_5.4.2_3.0_1724335308780.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dialogsum_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dialogsum_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dialogsum_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.8 MB| + +## References + +https://huggingface.co/ShirinP/dialogsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_00001b_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_00001b_en.md new file mode 100644 index 00000000000000..27bac206cea386 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_00001b_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_00001b T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_00001b +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_00001b` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_00001b_en_5.4.2_3.0_1724309136453.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_00001b_en_5.4.2_3.0_1724309136453.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_00001b","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_00001b", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_00001b| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-00001b \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_00001b_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_00001b_pipeline_en.md new file mode 100644 index 00000000000000..62e0843bdf4220 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_00001b_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_00001b_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_00001b_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_00001b_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_00001b_pipeline_en_5.4.2_3.0_1724309325155.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_00001b_pipeline_en_5.4.2_3.0_1724309325155.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_00001b_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_00001b_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_00001b_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-00001b + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_010099_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_010099_en.md new file mode 100644 index 00000000000000..8b35ae07e92a59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_010099_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_010099 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_en_5.4.2_3.0_1724332700423.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_en_5.4.2_3.0_1724332700423.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_010099","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_010099", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_010099_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_010099_pipeline_en.md new file mode 100644 index 00000000000000..8b6764b9f1585c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_010099_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_010099_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_010099_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_010099_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_pipeline_en_5.4.2_3.0_1724332892760.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_010099_pipeline_en_5.4.2_3.0_1724332892760.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_010099_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_010099_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_010099_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-010099 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_2_0_25_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_2_0_25_en.md new file mode 100644 index 00000000000000..5e372a47be32b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_2_0_25_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_2_0_25 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_2_0_25 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_2_0_25` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_0_25_en_5.4.2_3.0_1724336057298.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_0_25_en_5.4.2_3.0_1724336057298.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_2_0_25","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_2_0_25", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_2_0_25| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.2-0.25 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_2_0_25_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_2_0_25_pipeline_en.md new file mode 100644 index 00000000000000..003e5d45783927 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_2_0_25_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_2_0_25_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_2_0_25_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_2_0_25_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_0_25_pipeline_en_5.4.2_3.0_1724336251048.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_2_0_25_pipeline_en_5.4.2_3.0_1724336251048.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_2_0_25_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_2_0_25_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_2_0_25_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.2-0.25 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_6_0_25_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_6_0_25_en.md new file mode 100644 index 00000000000000..5106d88cf34757 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_6_0_25_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_6_0_25 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_6_0_25 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_6_0_25` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_0_25_en_5.4.2_3.0_1724314753199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_0_25_en_5.4.2_3.0_1724314753199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_6_0_25","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_6_0_25", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_6_0_25| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.6-0.25 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_6_0_25_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_6_0_25_pipeline_en.md new file mode 100644 index 00000000000000..b740c0fbabdabf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_6_0_25_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_6_0_25_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_6_0_25_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_6_0_25_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_0_25_pipeline_en_5.4.2_3.0_1724314933346.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_6_0_25_pipeline_en_5.4.2_3.0_1724314933346.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_6_0_25_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_6_0_25_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_6_0_25_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.6-0.25 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_8_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_8_2_en.md new file mode 100644 index 00000000000000..a618575a49fe30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_8_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_0_8_2 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_8_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_8_2` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_2_en_5.4.2_3.0_1724348940122.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_2_en_5.4.2_3.0_1724348940122.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_0_8_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_0_8_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_8_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.8-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_8_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_8_2_pipeline_en.md new file mode 100644 index 00000000000000..207df636ba4e90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_0_8_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_0_8_2_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_0_8_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_0_8_2_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_2_pipeline_en_5.4.2_3.0_1724349130581.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_0_8_2_pipeline_en_5.4.2_3.0_1724349130581.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_0_8_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_0_8_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_0_8_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-0.8-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_900010_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_900010_en.md new file mode 100644 index 00000000000000..587cf4a5034b54 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_900010_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_900010 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_900010 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_900010` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_900010_en_5.4.2_3.0_1724331117350.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_900010_en_5.4.2_3.0_1724331117350.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_900010","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_900010", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_900010| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-900010 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_900010_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_900010_pipeline_en.md new file mode 100644 index 00000000000000..aa0c30800dd9bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_900010_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_900010_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_900010_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_900010_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_900010_pipeline_en_5.4.2_3.0_1724331308499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_900010_pipeline_en_5.4.2_3.0_1724331308499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_900010_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_900010_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_900010_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-900010 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b0_5_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b0_5_en.md new file mode 100644 index 00000000000000..f6f42dceb9b869 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b0_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_b0_5 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b0_5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b0_5` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_5_en_5.4.2_3.0_1724297714221.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_5_en_5.4.2_3.0_1724297714221.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_b0_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_b0_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b0_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b0.5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b0_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b0_5_pipeline_en.md new file mode 100644 index 00000000000000..1932d194278e39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b0_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_b0_5_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b0_5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b0_5_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_5_pipeline_en_5.4.2_3.0_1724297910834.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b0_5_pipeline_en_5.4.2_3.0_1724297910834.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_b0_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_b0_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b0_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b0.5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b1_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b1_en.md new file mode 100644 index 00000000000000..7f10f5f70bddfb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English distilled_mt5_small_b1 T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b1` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b1_en_5.4.2_3.0_1724344742695.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b1_en_5.4.2_3.0_1724344742695.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("distilled_mt5_small_b1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("distilled_mt5_small_b1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b1_pipeline_en.md new file mode 100644 index 00000000000000..d28ecd2969e060 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-distilled_mt5_small_b1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English distilled_mt5_small_b1_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: distilled_mt5_small_b1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`distilled_mt5_small_b1_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b1_pipeline_en_5.4.2_3.0_1724344930309.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/distilled_mt5_small_b1_pipeline_en_5.4.2_3.0_1724344930309.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("distilled_mt5_small_b1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("distilled_mt5_small_b1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|distilled_mt5_small_b1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Lvxue/distilled-mt5-small-b1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-docu_t5_large_sindhi_en.md b/docs/_posts/ahmedlone127/2024-08-22-docu_t5_large_sindhi_en.md new file mode 100644 index 00000000000000..9c62c870d7d9e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-docu_t5_large_sindhi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English docu_t5_large_sindhi T5Transformer from elena-soare +author: John Snow Labs +name: docu_t5_large_sindhi +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`docu_t5_large_sindhi` is a English model originally trained by elena-soare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/docu_t5_large_sindhi_en_5.4.2_3.0_1724341940763.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/docu_t5_large_sindhi_en_5.4.2_3.0_1724341940763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("docu_t5_large_sindhi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("docu_t5_large_sindhi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|docu_t5_large_sindhi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/elena-soare/docu-t5-large-SD \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-docu_t5_large_sindhi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-docu_t5_large_sindhi_pipeline_en.md new file mode 100644 index 00000000000000..e602255c9a5462 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-docu_t5_large_sindhi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English docu_t5_large_sindhi_pipeline pipeline T5Transformer from elena-soare +author: John Snow Labs +name: docu_t5_large_sindhi_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`docu_t5_large_sindhi_pipeline` is a English model originally trained by elena-soare. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/docu_t5_large_sindhi_pipeline_en_5.4.2_3.0_1724342090751.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/docu_t5_large_sindhi_pipeline_en_5.4.2_3.0_1724342090751.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("docu_t5_large_sindhi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("docu_t5_large_sindhi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|docu_t5_large_sindhi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/elena-soare/docu-t5-large-SD + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-edgar_turkmen_instruct_base_inst_tune_en.md b/docs/_posts/ahmedlone127/2024-08-22-edgar_turkmen_instruct_base_inst_tune_en.md new file mode 100644 index 00000000000000..13df6d5d560d63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-edgar_turkmen_instruct_base_inst_tune_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English edgar_turkmen_instruct_base_inst_tune T5Transformer from him1411 +author: John Snow Labs +name: edgar_turkmen_instruct_base_inst_tune +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`edgar_turkmen_instruct_base_inst_tune` is a English model originally trained by him1411. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/edgar_turkmen_instruct_base_inst_tune_en_5.4.2_3.0_1724339933637.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/edgar_turkmen_instruct_base_inst_tune_en_5.4.2_3.0_1724339933637.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("edgar_turkmen_instruct_base_inst_tune","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("edgar_turkmen_instruct_base_inst_tune", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|edgar_turkmen_instruct_base_inst_tune| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/him1411/EDGAR-Tk-instruct-base-inst-tune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-email_extractor_model_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-email_extractor_model_t5_small_en.md new file mode 100644 index 00000000000000..534fe6dc458fb5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-email_extractor_model_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English email_extractor_model_t5_small T5Transformer from cmtn +author: John Snow Labs +name: email_extractor_model_t5_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`email_extractor_model_t5_small` is a English model originally trained by cmtn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/email_extractor_model_t5_small_en_5.4.2_3.0_1724286443908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/email_extractor_model_t5_small_en_5.4.2_3.0_1724286443908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("email_extractor_model_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("email_extractor_model_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|email_extractor_model_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|290.3 MB| + +## References + +https://huggingface.co/cmtn/email_extractor_model_t5_small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-email_extractor_model_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-email_extractor_model_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..97040763546844 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-email_extractor_model_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English email_extractor_model_t5_small_pipeline pipeline T5Transformer from cmtn +author: John Snow Labs +name: email_extractor_model_t5_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`email_extractor_model_t5_small_pipeline` is a English model originally trained by cmtn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/email_extractor_model_t5_small_pipeline_en_5.4.2_3.0_1724286469921.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/email_extractor_model_t5_small_pipeline_en_5.4.2_3.0_1724286469921.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("email_extractor_model_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("email_extractor_model_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|email_extractor_model_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|290.3 MB| + +## References + +https://huggingface.co/cmtn/email_extractor_model_t5_small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-english_french_trnslation_en.md b/docs/_posts/ahmedlone127/2024-08-22-english_french_trnslation_en.md new file mode 100644 index 00000000000000..a7486c94a8ada0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-english_french_trnslation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_french_trnslation T5Transformer from Hemg +author: John Snow Labs +name: english_french_trnslation +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_french_trnslation` is a English model originally trained by Hemg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_french_trnslation_en_5.4.2_3.0_1724314152024.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_french_trnslation_en_5.4.2_3.0_1724314152024.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_french_trnslation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_french_trnslation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_french_trnslation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|290.4 MB| + +## References + +https://huggingface.co/Hemg/en-fr-trnslation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-english_french_trnslation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-english_french_trnslation_pipeline_en.md new file mode 100644 index 00000000000000..848593d46f52b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-english_french_trnslation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_french_trnslation_pipeline pipeline T5Transformer from Hemg +author: John Snow Labs +name: english_french_trnslation_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_french_trnslation_pipeline` is a English model originally trained by Hemg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_french_trnslation_pipeline_en_5.4.2_3.0_1724314178790.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_french_trnslation_pipeline_en_5.4.2_3.0_1724314178790.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_french_trnslation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_french_trnslation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_french_trnslation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|290.4 MB| + +## References + +https://huggingface.co/Hemg/en-fr-trnslation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-english_mt5_small_15_spider_en.md b/docs/_posts/ahmedlone127/2024-08-22-english_mt5_small_15_spider_en.md new file mode 100644 index 00000000000000..79d849ba1340e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-english_mt5_small_15_spider_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_mt5_small_15_spider T5Transformer from e22vvb +author: John Snow Labs +name: english_mt5_small_15_spider +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mt5_small_15_spider` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mt5_small_15_spider_en_5.4.2_3.0_1724289259298.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mt5_small_15_spider_en_5.4.2_3.0_1724289259298.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_mt5_small_15_spider","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_mt5_small_15_spider", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mt5_small_15_spider| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/e22vvb/EN_mt5-small_15_spider \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-english_mt5_small_15_spider_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-english_mt5_small_15_spider_pipeline_en.md new file mode 100644 index 00000000000000..c6dc2d4deabbd8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-english_mt5_small_15_spider_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_mt5_small_15_spider_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_mt5_small_15_spider_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_mt5_small_15_spider_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_mt5_small_15_spider_pipeline_en_5.4.2_3.0_1724289450342.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_mt5_small_15_spider_pipeline_en_5.4.2_3.0_1724289450342.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_mt5_small_15_spider_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_mt5_small_15_spider_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_mt5_small_15_spider_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/e22vvb/EN_mt5-small_15_spider + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-english_t5_small_10_spider_en.md b/docs/_posts/ahmedlone127/2024-08-22-english_t5_small_10_spider_en.md new file mode 100644 index 00000000000000..c869c8b6837b00 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-english_t5_small_10_spider_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English english_t5_small_10_spider T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_small_10_spider +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_small_10_spider` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_small_10_spider_en_5.4.2_3.0_1724315467644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_small_10_spider_en_5.4.2_3.0_1724315467644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("english_t5_small_10_spider","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("english_t5_small_10_spider", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_small_10_spider| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.3 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-small_10_spider \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-english_t5_small_10_spider_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-english_t5_small_10_spider_pipeline_en.md new file mode 100644 index 00000000000000..5eb57fdd6a64c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-english_t5_small_10_spider_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English english_t5_small_10_spider_pipeline pipeline T5Transformer from e22vvb +author: John Snow Labs +name: english_t5_small_10_spider_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`english_t5_small_10_spider_pipeline` is a English model originally trained by e22vvb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/english_t5_small_10_spider_pipeline_en_5.4.2_3.0_1724315488832.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/english_t5_small_10_spider_pipeline_en_5.4.2_3.0_1724315488832.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("english_t5_small_10_spider_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("english_t5_small_10_spider_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|english_t5_small_10_spider_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.3 MB| + +## References + +https://huggingface.co/e22vvb/EN_t5-small_10_spider + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-enqa_t5small_train_16ep_en.md b/docs/_posts/ahmedlone127/2024-08-22-enqa_t5small_train_16ep_en.md new file mode 100644 index 00000000000000..3cd7d9c9985876 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-enqa_t5small_train_16ep_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English enqa_t5small_train_16ep T5Transformer from shiontendon +author: John Snow Labs +name: enqa_t5small_train_16ep +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`enqa_t5small_train_16ep` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/enqa_t5small_train_16ep_en_5.4.2_3.0_1724297576848.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/enqa_t5small_train_16ep_en_5.4.2_3.0_1724297576848.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("enqa_t5small_train_16ep","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("enqa_t5small_train_16ep", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|enqa_t5small_train_16ep| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|313.0 MB| + +## References + +https://huggingface.co/shiontendon/EnQA_T5small_train_16ep \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-enqa_t5small_train_16ep_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-enqa_t5small_train_16ep_pipeline_en.md new file mode 100644 index 00000000000000..4b4131d50f8b1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-enqa_t5small_train_16ep_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English enqa_t5small_train_16ep_pipeline pipeline T5Transformer from shiontendon +author: John Snow Labs +name: enqa_t5small_train_16ep_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`enqa_t5small_train_16ep_pipeline` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/enqa_t5small_train_16ep_pipeline_en_5.4.2_3.0_1724297594868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/enqa_t5small_train_16ep_pipeline_en_5.4.2_3.0_1724297594868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("enqa_t5small_train_16ep_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("enqa_t5small_train_16ep_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|enqa_t5small_train_16ep_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|313.0 MB| + +## References + +https://huggingface.co/shiontendon/EnQA_T5small_train_16ep + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-events_mem_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-events_mem_small_en.md new file mode 100644 index 00000000000000..8ebaeb6d06a8bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-events_mem_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English events_mem_small T5Transformer from eddieman78 +author: John Snow Labs +name: events_mem_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`events_mem_small` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/events_mem_small_en_5.4.2_3.0_1724364118486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/events_mem_small_en_5.4.2_3.0_1724364118486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("events_mem_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("events_mem_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|events_mem_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/eddieman78/events-mem-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-events_mem_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-events_mem_small_pipeline_en.md new file mode 100644 index 00000000000000..5c2f4d2d4ebd58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-events_mem_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English events_mem_small_pipeline pipeline T5Transformer from eddieman78 +author: John Snow Labs +name: events_mem_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`events_mem_small_pipeline` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/events_mem_small_pipeline_en_5.4.2_3.0_1724364135942.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/events_mem_small_pipeline_en_5.4.2_3.0_1724364135942.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("events_mem_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("events_mem_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|events_mem_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/eddieman78/events-mem-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_en.md b/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_en.md new file mode 100644 index 00000000000000..c95de658d51298 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English extract_long_text_unbalanced_smaller T5Transformer from weny22 +author: John Snow Labs +name: extract_long_text_unbalanced_smaller +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`extract_long_text_unbalanced_smaller` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/extract_long_text_unbalanced_smaller_en_5.4.2_3.0_1724363101296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/extract_long_text_unbalanced_smaller_en_5.4.2_3.0_1724363101296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("extract_long_text_unbalanced_smaller","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("extract_long_text_unbalanced_smaller", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|extract_long_text_unbalanced_smaller| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|403.9 MB| + +## References + +https://huggingface.co/weny22/extract_long_text_unbalanced_smaller \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_original_text_4_en.md b/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_original_text_4_en.md new file mode 100644 index 00000000000000..b3833a04ef51cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_original_text_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English extract_long_text_unbalanced_smaller_original_text_4 T5Transformer from weny22 +author: John Snow Labs +name: extract_long_text_unbalanced_smaller_original_text_4 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`extract_long_text_unbalanced_smaller_original_text_4` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/extract_long_text_unbalanced_smaller_original_text_4_en_5.4.2_3.0_1724325594452.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/extract_long_text_unbalanced_smaller_original_text_4_en_5.4.2_3.0_1724325594452.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("extract_long_text_unbalanced_smaller_original_text_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("extract_long_text_unbalanced_smaller_original_text_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|extract_long_text_unbalanced_smaller_original_text_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|403.9 MB| + +## References + +https://huggingface.co/weny22/extract_long_text_unbalanced_smaller_original_text_4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_original_text_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_original_text_4_pipeline_en.md new file mode 100644 index 00000000000000..7d970288950a45 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_original_text_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English extract_long_text_unbalanced_smaller_original_text_4_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: extract_long_text_unbalanced_smaller_original_text_4_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`extract_long_text_unbalanced_smaller_original_text_4_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/extract_long_text_unbalanced_smaller_original_text_4_pipeline_en_5.4.2_3.0_1724325614311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/extract_long_text_unbalanced_smaller_original_text_4_pipeline_en_5.4.2_3.0_1724325614311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("extract_long_text_unbalanced_smaller_original_text_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("extract_long_text_unbalanced_smaller_original_text_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|extract_long_text_unbalanced_smaller_original_text_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|403.9 MB| + +## References + +https://huggingface.co/weny22/extract_long_text_unbalanced_smaller_original_text_4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_pipeline_en.md new file mode 100644 index 00000000000000..4e2ed8897cb115 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-extract_long_text_unbalanced_smaller_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English extract_long_text_unbalanced_smaller_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: extract_long_text_unbalanced_smaller_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`extract_long_text_unbalanced_smaller_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/extract_long_text_unbalanced_smaller_pipeline_en_5.4.2_3.0_1724363122075.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/extract_long_text_unbalanced_smaller_pipeline_en_5.4.2_3.0_1724363122075.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("extract_long_text_unbalanced_smaller_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("extract_long_text_unbalanced_smaller_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|extract_long_text_unbalanced_smaller_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|403.9 MB| + +## References + +https://huggingface.co/weny22/extract_long_text_unbalanced_smaller + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1_en.md new file mode 100644 index 00000000000000..096e20b1c19b5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1 T5Transformer from tau +author: John Snow Labs +name: false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1` is a English model originally trained by tau. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1_en_5.4.2_3.0_1724335052256.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1_en_5.4.2_3.0_1724335052256.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|false_large_pmi_paranone_sentnone_span0_ittrue_sargmax_rrfalse_8_1024_0_15_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/tau/False_large_pmi_paraNone_sentNone_span0_itTrue_sargmax_rrFalse_8_1024_0.15_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-finetune_segmentation_t5_super_tiny_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-22-finetune_segmentation_t5_super_tiny_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..aa1b19a2fc0fa4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-finetune_segmentation_t5_super_tiny_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_segmentation_t5_super_tiny_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_segmentation_t5_super_tiny_standard_bahasa_cased +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_segmentation_t5_super_tiny_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_segmentation_t5_super_tiny_standard_bahasa_cased_en_5.4.2_3.0_1724311591814.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_segmentation_t5_super_tiny_standard_bahasa_cased_en_5.4.2_3.0_1724311591814.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_segmentation_t5_super_tiny_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_segmentation_t5_super_tiny_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_segmentation_t5_super_tiny_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|109.5 MB| + +## References + +https://huggingface.co/mesolitica/finetune-segmentation-t5-super-tiny-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..111f9dfe764ea0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724311597225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724311597225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_segmentation_t5_super_tiny_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|109.5 MB| + +## References + +https://huggingface.co/mesolitica/finetune-segmentation-t5-super-tiny-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-finetuned_mt5_base_10epoch_en.md b/docs/_posts/ahmedlone127/2024-08-22-finetuned_mt5_base_10epoch_en.md new file mode 100644 index 00000000000000..63f242dc5fbebc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-finetuned_mt5_base_10epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_mt5_base_10epoch T5Transformer from Lvxue +author: John Snow Labs +name: finetuned_mt5_base_10epoch +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_mt5_base_10epoch` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_mt5_base_10epoch_en_5.4.2_3.0_1724365275201.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_mt5_base_10epoch_en_5.4.2_3.0_1724365275201.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_mt5_base_10epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_mt5_base_10epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_mt5_base_10epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/Lvxue/finetuned-mt5-base-10epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-finetuned_mt5_base_10epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-finetuned_mt5_base_10epoch_pipeline_en.md new file mode 100644 index 00000000000000..e909566ac54876 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-finetuned_mt5_base_10epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_mt5_base_10epoch_pipeline pipeline T5Transformer from Lvxue +author: John Snow Labs +name: finetuned_mt5_base_10epoch_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_mt5_base_10epoch_pipeline` is a English model originally trained by Lvxue. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_mt5_base_10epoch_pipeline_en_5.4.2_3.0_1724365551198.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_mt5_base_10epoch_pipeline_en_5.4.2_3.0_1724365551198.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_mt5_base_10epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_mt5_base_10epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_mt5_base_10epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/Lvxue/finetuned-mt5-base-10epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-finetuned_t5_palistha_en.md b/docs/_posts/ahmedlone127/2024-08-22-finetuned_t5_palistha_en.md new file mode 100644 index 00000000000000..1a2368378d85cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-finetuned_t5_palistha_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_t5_palistha T5Transformer from Palistha +author: John Snow Labs +name: finetuned_t5_palistha +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_palistha` is a English model originally trained by Palistha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_palistha_en_5.4.2_3.0_1724361158047.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_palistha_en_5.4.2_3.0_1724361158047.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_t5_palistha","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_t5_palistha", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_palistha| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.3 MB| + +## References + +https://huggingface.co/Palistha/finetuned-T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-finetuned_t5_palistha_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-finetuned_t5_palistha_pipeline_en.md new file mode 100644 index 00000000000000..2a5766a8a471f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-finetuned_t5_palistha_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_t5_palistha_pipeline pipeline T5Transformer from Palistha +author: John Snow Labs +name: finetuned_t5_palistha_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_palistha_pipeline` is a English model originally trained by Palistha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_palistha_pipeline_en_5.4.2_3.0_1724361176531.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_palistha_pipeline_en_5.4.2_3.0_1724361176531.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_t5_palistha_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_t5_palistha_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_palistha_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.3 MB| + +## References + +https://huggingface.co/Palistha/finetuned-T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_base_select_search_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_base_select_search_en.md new file mode 100644 index 00000000000000..11133ece46c316 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_base_select_search_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_base_select_search T5Transformer from helliun +author: John Snow Labs +name: flan_base_select_search +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_base_select_search` is a English model originally trained by helliun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_base_select_search_en_5.4.2_3.0_1724315294772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_base_select_search_en_5.4.2_3.0_1724315294772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_base_select_search","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_base_select_search", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_base_select_search| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/helliun/flan-base-select-search \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_base_select_search_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_base_select_search_pipeline_en.md new file mode 100644 index 00000000000000..f3d22dc91499ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_base_select_search_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_base_select_search_pipeline pipeline T5Transformer from helliun +author: John Snow Labs +name: flan_base_select_search_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_base_select_search_pipeline` is a English model originally trained by helliun. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_base_select_search_pipeline_en_5.4.2_3.0_1724315342430.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_base_select_search_pipeline_en_5.4.2_3.0_1724315342430.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_base_select_search_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_base_select_search_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_base_select_search_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/helliun/flan-base-select-search + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_200_finetuned_medical_data_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_200_finetuned_medical_data_en.md new file mode 100644 index 00000000000000..6e0422d577722d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_200_finetuned_medical_data_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_200_finetuned_medical_data T5Transformer from nikhil928 +author: John Snow Labs +name: flan_t5_base_200_finetuned_medical_data +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_200_finetuned_medical_data` is a English model originally trained by nikhil928. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_200_finetuned_medical_data_en_5.4.2_3.0_1724307887675.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_200_finetuned_medical_data_en_5.4.2_3.0_1724307887675.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_200_finetuned_medical_data","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_200_finetuned_medical_data", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_200_finetuned_medical_data| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.6 MB| + +## References + +https://huggingface.co/nikhil928/flan-t5-base-200-finetuned-medical-data \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_200_finetuned_medical_data_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_200_finetuned_medical_data_pipeline_en.md new file mode 100644 index 00000000000000..20a5123acc5aa4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_200_finetuned_medical_data_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_200_finetuned_medical_data_pipeline pipeline T5Transformer from nikhil928 +author: John Snow Labs +name: flan_t5_base_200_finetuned_medical_data_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_200_finetuned_medical_data_pipeline` is a English model originally trained by nikhil928. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_200_finetuned_medical_data_pipeline_en_5.4.2_3.0_1724308057020.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_200_finetuned_medical_data_pipeline_en_5.4.2_3.0_1724308057020.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_200_finetuned_medical_data_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_200_finetuned_medical_data_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_200_finetuned_medical_data_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.6 MB| + +## References + +https://huggingface.co/nikhil928/flan-t5-base-200-finetuned-medical-data + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_6_1_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_6_1_cnndm_en.md new file mode 100644 index 00000000000000..4bedfe6459e37a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_6_1_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_6_1_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_6_1_cnndm +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_6_1_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_1_cnndm_en_5.4.2_3.0_1724311731057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_1_cnndm_en_5.4.2_3.0_1724311731057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_6_1_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_6_1_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_6_1_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|665.6 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-6-1-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_6_1_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_6_1_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..ac2bbced994303 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_6_1_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_6_1_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_base_6_1_cnndm_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_6_1_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_1_cnndm_pipeline_en_5.4.2_3.0_1724311763160.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_6_1_cnndm_pipeline_en_5.4.2_3.0_1724311763160.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_6_1_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_6_1_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_6_1_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|665.6 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-base-6-1-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_askscience_qg_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_askscience_qg_en.md new file mode 100644 index 00000000000000..e1fd078b33e412 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_askscience_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_askscience_qg T5Transformer from dhmeltzer +author: John Snow Labs +name: flan_t5_base_askscience_qg +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_askscience_qg` is a English model originally trained by dhmeltzer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_askscience_qg_en_5.4.2_3.0_1724369348661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_askscience_qg_en_5.4.2_3.0_1724369348661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_askscience_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_askscience_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_askscience_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dhmeltzer/flan-t5-base_askscience-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_askscience_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_askscience_qg_pipeline_en.md new file mode 100644 index 00000000000000..3ed7a7675f9f35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_askscience_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_askscience_qg_pipeline pipeline T5Transformer from dhmeltzer +author: John Snow Labs +name: flan_t5_base_askscience_qg_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_askscience_qg_pipeline` is a English model originally trained by dhmeltzer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_askscience_qg_pipeline_en_5.4.2_3.0_1724369395369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_askscience_qg_pipeline_en_5.4.2_3.0_1724369395369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_askscience_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_askscience_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_askscience_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dhmeltzer/flan-t5-base_askscience-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_finetuned_pwkp_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_finetuned_pwkp_en.md new file mode 100644 index 00000000000000..529f0c0e32fa43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_finetuned_pwkp_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_finetuned_pwkp T5Transformer from ismet +author: John Snow Labs +name: flan_t5_base_finetuned_pwkp +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_pwkp` is a English model originally trained by ismet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_pwkp_en_5.4.2_3.0_1724359178716.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_pwkp_en_5.4.2_3.0_1724359178716.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_finetuned_pwkp","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_finetuned_pwkp", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_pwkp| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ismet/flan-t5-base-finetuned-pwkp \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_finetuned_pwkp_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_finetuned_pwkp_pipeline_en.md new file mode 100644 index 00000000000000..3157d8f0907e46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_finetuned_pwkp_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_finetuned_pwkp_pipeline pipeline T5Transformer from ismet +author: John Snow Labs +name: flan_t5_base_finetuned_pwkp_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_finetuned_pwkp_pipeline` is a English model originally trained by ismet. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_pwkp_pipeline_en_5.4.2_3.0_1724359224896.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_finetuned_pwkp_pipeline_en_5.4.2_3.0_1724359224896.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_finetuned_pwkp_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_finetuned_pwkp_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_finetuned_pwkp_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ismet/flan-t5-base-finetuned-pwkp + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_fold_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_fold_2_en.md new file mode 100644 index 00000000000000..570b81af55e750 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_fold_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_fold_2 T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_base_fold_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_fold_2` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_fold_2_en_5.4.2_3.0_1724330337337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_fold_2_en_5.4.2_3.0_1724330337337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_fold_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_fold_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_fold_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-dump/flan-t5-base_fold_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_fold_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_fold_2_pipeline_en.md new file mode 100644 index 00000000000000..90545e2bc78002 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_fold_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_fold_2_pipeline pipeline T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_base_fold_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_fold_2_pipeline` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_fold_2_pipeline_en_5.4.2_3.0_1724330386294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_fold_2_pipeline_en_5.4.2_3.0_1724330386294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_fold_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_fold_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_fold_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-dump/flan-t5-base_fold_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_gecfirst_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_gecfirst_e8_b16_en.md new file mode 100644 index 00000000000000..80d50ecd273da2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_gecfirst_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_gecfirst_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_base_gecfirst_e8_b16 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_gecfirst_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_gecfirst_e8_b16_en_5.4.2_3.0_1724317455299.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_gecfirst_e8_b16_en_5.4.2_3.0_1724317455299.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_gecfirst_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_gecfirst_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_gecfirst_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-base-gecfirst-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_gecfirst_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_gecfirst_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..979b9ed355f6ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_gecfirst_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_gecfirst_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_base_gecfirst_e8_b16_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_gecfirst_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_gecfirst_e8_b16_pipeline_en_5.4.2_3.0_1724317503542.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_gecfirst_e8_b16_pipeline_en_5.4.2_3.0_1724317503542.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_gecfirst_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_gecfirst_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_gecfirst_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-base-gecfirst-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_master_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_master_1_en.md new file mode 100644 index 00000000000000..4bb2f4ec98c5c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_master_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_master_1 T5Transformer from prnv13 +author: John Snow Labs +name: flan_t5_base_master_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_master_1` is a English model originally trained by prnv13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_1_en_5.4.2_3.0_1724325104869.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_1_en_5.4.2_3.0_1724325104869.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_master_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_master_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_master_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/prnv13/flan-t5-base-master-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_master_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_master_1_pipeline_en.md new file mode 100644 index 00000000000000..0b5a12fd34699e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_master_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_master_1_pipeline pipeline T5Transformer from prnv13 +author: John Snow Labs +name: flan_t5_base_master_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_master_1_pipeline` is a English model originally trained by prnv13. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_1_pipeline_en_5.4.2_3.0_1724325152583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_master_1_pipeline_en_5.4.2_3.0_1724325152583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_master_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_master_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_master_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/prnv13/flan-t5-base-master-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_premise_conclusion_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_premise_conclusion_en.md new file mode 100644 index 00000000000000..ff3e5b9a4ca829 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_premise_conclusion_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_premise_conclusion T5Transformer from Mike-HF +author: John Snow Labs +name: flan_t5_base_premise_conclusion +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_premise_conclusion` is a English model originally trained by Mike-HF. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_premise_conclusion_en_5.4.2_3.0_1724370096817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_premise_conclusion_en_5.4.2_3.0_1724370096817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_premise_conclusion","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_premise_conclusion", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_premise_conclusion| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Mike-HF/flan-t5-base-premise-conclusion \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_premise_conclusion_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_premise_conclusion_pipeline_en.md new file mode 100644 index 00000000000000..b6a8ec71e9c66c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_premise_conclusion_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_premise_conclusion_pipeline pipeline T5Transformer from Mike-HF +author: John Snow Labs +name: flan_t5_base_premise_conclusion_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_premise_conclusion_pipeline` is a English model originally trained by Mike-HF. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_premise_conclusion_pipeline_en_5.4.2_3.0_1724370144232.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_premise_conclusion_pipeline_en_5.4.2_3.0_1724370144232.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_premise_conclusion_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_premise_conclusion_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_premise_conclusion_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Mike-HF/flan-t5-base-premise-conclusion + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_qg_squad_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_qg_squad_v2_en.md new file mode 100644 index 00000000000000..097e5e923eb703 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_qg_squad_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_qg_squad_v2 T5Transformer from sidovic +author: John Snow Labs +name: flan_t5_base_qg_squad_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_qg_squad_v2` is a English model originally trained by sidovic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_qg_squad_v2_en_5.4.2_3.0_1724303432369.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_qg_squad_v2_en_5.4.2_3.0_1724303432369.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_qg_squad_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_qg_squad_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_qg_squad_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sidovic/flan-t5-base-qg-squad_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_qg_squad_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_qg_squad_v2_pipeline_en.md new file mode 100644 index 00000000000000..0f7b1521111f2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_qg_squad_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_qg_squad_v2_pipeline pipeline T5Transformer from sidovic +author: John Snow Labs +name: flan_t5_base_qg_squad_v2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_qg_squad_v2_pipeline` is a English model originally trained by sidovic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_qg_squad_v2_pipeline_en_5.4.2_3.0_1724303483378.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_qg_squad_v2_pipeline_en_5.4.2_3.0_1724303483378.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_qg_squad_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_qg_squad_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_qg_squad_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sidovic/flan-t5-base-qg-squad_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_rottenlemons_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_rottenlemons_en.md new file mode 100644 index 00000000000000..ce8ea18ac32dcd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_rottenlemons_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_rottenlemons T5Transformer from RottenLemons +author: John Snow Labs +name: flan_t5_base_rottenlemons +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_rottenlemons` is a English model originally trained by RottenLemons. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_rottenlemons_en_5.4.2_3.0_1724286666639.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_rottenlemons_en_5.4.2_3.0_1724286666639.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_rottenlemons","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_rottenlemons", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_rottenlemons| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RottenLemons/flan-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_rottenlemons_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_rottenlemons_pipeline_en.md new file mode 100644 index 00000000000000..1e3f2766e326a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_rottenlemons_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_rottenlemons_pipeline pipeline T5Transformer from RottenLemons +author: John Snow Labs +name: flan_t5_base_rottenlemons_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_rottenlemons_pipeline` is a English model originally trained by RottenLemons. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_rottenlemons_pipeline_en_5.4.2_3.0_1724286713968.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_rottenlemons_pipeline_en_5.4.2_3.0_1724286713968.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_rottenlemons_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_rottenlemons_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_rottenlemons_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/RottenLemons/flan-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_samsum_szycha_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_samsum_szycha_en.md new file mode 100644 index 00000000000000..595cc73f39be21 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_samsum_szycha_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_samsum_szycha T5Transformer from Szycha +author: John Snow Labs +name: flan_t5_base_samsum_szycha +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_szycha` is a English model originally trained by Szycha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_szycha_en_5.4.2_3.0_1724331123462.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_szycha_en_5.4.2_3.0_1724331123462.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_samsum_szycha","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_samsum_szycha", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_szycha| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Szycha/flan-t5-base-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_samsum_szycha_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_samsum_szycha_pipeline_en.md new file mode 100644 index 00000000000000..ec455dc2ff8779 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_samsum_szycha_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_samsum_szycha_pipeline pipeline T5Transformer from Szycha +author: John Snow Labs +name: flan_t5_base_samsum_szycha_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_samsum_szycha_pipeline` is a English model originally trained by Szycha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_szycha_pipeline_en_5.4.2_3.0_1724331170799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_samsum_szycha_pipeline_en_5.4.2_3.0_1724331170799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_samsum_szycha_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_samsum_szycha_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_samsum_szycha_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Szycha/flan-t5-base-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_squad_qag_ep12_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_squad_qag_ep12_en.md new file mode 100644 index 00000000000000..ae466c4de5e5d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_squad_qag_ep12_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_squad_qag_ep12 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_squad_qag_ep12 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_qag_ep12` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_ep12_en_5.4.2_3.0_1724347976814.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_ep12_en_5.4.2_3.0_1724347976814.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_squad_qag_ep12","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_squad_qag_ep12", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_qag_ep12| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-SQuAD-qag-ep12 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_squad_qag_ep12_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_squad_qag_ep12_pipeline_en.md new file mode 100644 index 00000000000000..61ccb252d57fc9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_base_squad_qag_ep12_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_squad_qag_ep12_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_base_squad_qag_ep12_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_squad_qag_ep12_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_ep12_pipeline_en_5.4.2_3.0_1724348023292.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_squad_qag_ep12_pipeline_en_5.4.2_3.0_1724348023292.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_squad_qag_ep12_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_squad_qag_ep12_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_squad_qag_ep12_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-base-SQuAD-qag-ep12 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_cbp_lkg_qa_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_cbp_lkg_qa_small_finetuned_en.md new file mode 100644 index 00000000000000..b92d5da77580c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_cbp_lkg_qa_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_cbp_lkg_qa_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_cbp_lkg_qa_small_finetuned +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_cbp_lkg_qa_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_qa_small_finetuned_en_5.4.2_3.0_1724332864315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_qa_small_finetuned_en_5.4.2_3.0_1724332864315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_cbp_lkg_qa_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_cbp_lkg_qa_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_cbp_lkg_qa_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-cbp-lkg-qa-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_cbp_lkg_qa_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_cbp_lkg_qa_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..af2e12f6156009 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_cbp_lkg_qa_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_cbp_lkg_qa_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_cbp_lkg_qa_small_finetuned_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_cbp_lkg_qa_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_qa_small_finetuned_pipeline_en_5.4.2_3.0_1724332894756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_cbp_lkg_qa_small_finetuned_pipeline_en_5.4.2_3.0_1724332894756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_cbp_lkg_qa_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_cbp_lkg_qa_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_cbp_lkg_qa_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-cbp-lkg-qa-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_finetuned_sohaib9920_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_finetuned_sohaib9920_en.md new file mode 100644 index 00000000000000..90487aa2448001 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_finetuned_sohaib9920_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_finetuned_sohaib9920 T5Transformer from Sohaib9920 +author: John Snow Labs +name: flan_t5_finetuned_sohaib9920 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_finetuned_sohaib9920` is a English model originally trained by Sohaib9920. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_finetuned_sohaib9920_en_5.4.2_3.0_1724352975598.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_finetuned_sohaib9920_en_5.4.2_3.0_1724352975598.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_finetuned_sohaib9920","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_finetuned_sohaib9920", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_finetuned_sohaib9920| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Sohaib9920/flan-t5-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_finetuned_sohaib9920_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_finetuned_sohaib9920_pipeline_en.md new file mode 100644 index 00000000000000..897ffe28668093 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_finetuned_sohaib9920_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_finetuned_sohaib9920_pipeline pipeline T5Transformer from Sohaib9920 +author: John Snow Labs +name: flan_t5_finetuned_sohaib9920_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_finetuned_sohaib9920_pipeline` is a English model originally trained by Sohaib9920. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_finetuned_sohaib9920_pipeline_en_5.4.2_3.0_1724353025008.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_finetuned_sohaib9920_pipeline_en_5.4.2_3.0_1724353025008.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_finetuned_sohaib9920_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_finetuned_sohaib9920_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_finetuned_sohaib9920_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Sohaib9920/flan-t5-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_en.md new file mode 100644 index 00000000000000..09e5374efc93ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_en_5.4.2_3.0_1724327766591.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_en_5.4.2_3.0_1724327766591.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.1 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-kelm-tekgen-kg-direct-w-context-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..862baba289f906 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline_en_5.4.2_3.0_1724327784024.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline_en_5.4.2_3.0_1724327784024.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_kelm_tekgen_kongo_direct_w_context_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.1 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-kelm-tekgen-kg-direct-w-context-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_analogy_permutation_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_analogy_permutation_en.md new file mode 100644 index 00000000000000..bfc8d390896865 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_analogy_permutation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_analogy_permutation T5Transformer from research-backup +author: John Snow Labs +name: flan_t5_large_analogy_permutation +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_analogy_permutation` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_analogy_permutation_en_5.4.2_3.0_1724326057652.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_analogy_permutation_en_5.4.2_3.0_1724326057652.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_analogy_permutation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_analogy_permutation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_analogy_permutation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/research-backup/flan-t5-large-analogy-permutation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_analogy_permutation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_analogy_permutation_pipeline_en.md new file mode 100644 index 00000000000000..bc9a90b9a2fcea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_analogy_permutation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_analogy_permutation_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: flan_t5_large_analogy_permutation_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_analogy_permutation_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_analogy_permutation_pipeline_en_5.4.2_3.0_1724326201145.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_analogy_permutation_pipeline_en_5.4.2_3.0_1724326201145.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_analogy_permutation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_analogy_permutation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_analogy_permutation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/research-backup/flan-t5-large-analogy-permutation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_bottleneck_adapter_cpgqa_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_bottleneck_adapter_cpgqa_en.md new file mode 100644 index 00000000000000..93f079aac51121 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_bottleneck_adapter_cpgqa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_bottleneck_adapter_cpgqa T5Transformer from legacy107 +author: John Snow Labs +name: flan_t5_large_bottleneck_adapter_cpgqa +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_bottleneck_adapter_cpgqa` is a English model originally trained by legacy107. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_bottleneck_adapter_cpgqa_en_5.4.2_3.0_1724296099225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_bottleneck_adapter_cpgqa_en_5.4.2_3.0_1724296099225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_bottleneck_adapter_cpgqa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_bottleneck_adapter_cpgqa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_bottleneck_adapter_cpgqa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/legacy107/flan-t5-large-bottleneck-adapter-cpgQA \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_bottleneck_adapter_cpgqa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_bottleneck_adapter_cpgqa_pipeline_en.md new file mode 100644 index 00000000000000..00fc64702775f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_bottleneck_adapter_cpgqa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_bottleneck_adapter_cpgqa_pipeline pipeline T5Transformer from legacy107 +author: John Snow Labs +name: flan_t5_large_bottleneck_adapter_cpgqa_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_bottleneck_adapter_cpgqa_pipeline` is a English model originally trained by legacy107. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_bottleneck_adapter_cpgqa_pipeline_en_5.4.2_3.0_1724296232580.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_bottleneck_adapter_cpgqa_pipeline_en_5.4.2_3.0_1724296232580.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_bottleneck_adapter_cpgqa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_bottleneck_adapter_cpgqa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_bottleneck_adapter_cpgqa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/legacy107/flan-t5-large-bottleneck-adapter-cpgQA + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_0_400_loss_ep50_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_0_400_loss_ep50_en.md new file mode 100644 index 00000000000000..1b85e8737f7ff8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_0_400_loss_ep50_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_400_loss_ep50 T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_400_loss_ep50 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_400_loss_ep50` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_loss_ep50_en_5.4.2_3.0_1724337681599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_loss_ep50_en_5.4.2_3.0_1724337681599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_loss_ep50","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_0_400_loss_ep50", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_400_loss_ep50| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_400-loss-ep50 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline_en.md new file mode 100644 index 00000000000000..8cd500c881138b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline_en_5.4.2_3.0_1724337814300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline_en_5.4.2_3.0_1724337814300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_0_400_loss_ep50_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.0_400-loss-ep50 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_en.md new file mode 100644 index 00000000000000..02284da1e8cc71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_en_5.4.2_3.0_1724323625405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_en_5.4.2_3.0_1724323625405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_80-ep25-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..e1499ae3d07b4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline_en_5.4.2_3.0_1724323772584.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline_en_5.4.2_3.0_1724323772584.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_danish_multiwoz2_1_80_ep25_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-da-multiwoz2.1_80-ep25-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_en.md new file mode 100644 index 00000000000000..7cbd695bfd032c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_en_5.4.2_3.0_1724356652906.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_en_5.4.2_3.0_1724356652906.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-cnndm_2000-ep5-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..2863411bae3cf2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline_en_5.4.2_3.0_1724356789528.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline_en_5.4.2_3.0_1724356789528.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_cnndm_2000_ep5_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-cnndm_2000-ep5-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_dm_4000_ep25_nonstop_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_dm_4000_ep25_nonstop_en.md new file mode 100644 index 00000000000000..bc008694897efc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_dm_4000_ep25_nonstop_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_dm_4000_ep25_nonstop T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_dm_4000_ep25_nonstop +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_dm_4000_ep25_nonstop` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_dm_4000_ep25_nonstop_en_5.4.2_3.0_1724355339114.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_dm_4000_ep25_nonstop_en_5.4.2_3.0_1724355339114.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_dm_4000_ep25_nonstop","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_extraction_all_dm_4000_ep25_nonstop", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_dm_4000_ep25_nonstop| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-dm_4000-ep25-nonstop \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline_en.md new file mode 100644 index 00000000000000..26b311beca6aae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline pipeline T5Transformer from Zekunli +author: John Snow Labs +name: flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline` is a English model originally trained by Zekunli. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline_en_5.4.2_3.0_1724355486897.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline_en_5.4.2_3.0_1724355486897.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_extraction_all_dm_4000_ep25_nonstop_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Zekunli/flan-t5-large-extraction-all-dm_4000-ep25-nonstop + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_gecfirst_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_gecfirst_e8_b16_en.md new file mode 100644 index 00000000000000..30ef716e9fddd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_gecfirst_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_gecfirst_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_large_gecfirst_e8_b16 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_gecfirst_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_gecfirst_e8_b16_en_5.4.2_3.0_1724336929266.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_gecfirst_e8_b16_en_5.4.2_3.0_1724336929266.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_gecfirst_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_gecfirst_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_gecfirst_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-large-gecfirst-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_gecfirst_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_gecfirst_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..75b9a7ca1a54ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_gecfirst_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_gecfirst_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: flan_t5_large_gecfirst_e8_b16_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_gecfirst_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_gecfirst_e8_b16_pipeline_en_5.4.2_3.0_1724337097001.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_gecfirst_e8_b16_pipeline_en_5.4.2_3.0_1724337097001.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_gecfirst_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_gecfirst_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_gecfirst_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/jeremyvictor/flan-t5-large-gecfirst-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_ia3_cpgqa_merged_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_ia3_cpgqa_merged_en.md new file mode 100644 index 00000000000000..cf65e5bd0922db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_ia3_cpgqa_merged_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_ia3_cpgqa_merged T5Transformer from legacy107 +author: John Snow Labs +name: flan_t5_large_ia3_cpgqa_merged +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_ia3_cpgqa_merged` is a English model originally trained by legacy107. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_ia3_cpgqa_merged_en_5.4.2_3.0_1724294925463.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_ia3_cpgqa_merged_en_5.4.2_3.0_1724294925463.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_ia3_cpgqa_merged","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_ia3_cpgqa_merged", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_ia3_cpgqa_merged| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/legacy107/flan-t5-large-ia3-cpgQA-merged \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_ia3_cpgqa_merged_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_ia3_cpgqa_merged_pipeline_en.md new file mode 100644 index 00000000000000..c0f0efd1ec23a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_ia3_cpgqa_merged_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_ia3_cpgqa_merged_pipeline pipeline T5Transformer from legacy107 +author: John Snow Labs +name: flan_t5_large_ia3_cpgqa_merged_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_ia3_cpgqa_merged_pipeline` is a English model originally trained by legacy107. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_ia3_cpgqa_merged_pipeline_en_5.4.2_3.0_1724295065108.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_ia3_cpgqa_merged_pipeline_en_5.4.2_3.0_1724295065108.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_ia3_cpgqa_merged_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_ia3_cpgqa_merged_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_ia3_cpgqa_merged_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/legacy107/flan-t5-large-ia3-cpgQA-merged + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_noun_completion_german_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_noun_completion_german_en.md new file mode 100644 index 00000000000000..8d33fcba48f81d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_noun_completion_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_noun_completion_german T5Transformer from Kartikey95 +author: John Snow Labs +name: flan_t5_large_noun_completion_german +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_noun_completion_german` is a English model originally trained by Kartikey95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_noun_completion_german_en_5.4.2_3.0_1724300488637.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_noun_completion_german_en_5.4.2_3.0_1724300488637.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_noun_completion_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_noun_completion_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_noun_completion_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Kartikey95/flan-t5-large-noun-completion-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_noun_completion_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_noun_completion_german_pipeline_en.md new file mode 100644 index 00000000000000..5e6fcfc1799f33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_large_noun_completion_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_noun_completion_german_pipeline pipeline T5Transformer from Kartikey95 +author: John Snow Labs +name: flan_t5_large_noun_completion_german_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_noun_completion_german_pipeline` is a English model originally trained by Kartikey95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_noun_completion_german_pipeline_en_5.4.2_3.0_1724300619612.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_noun_completion_german_pipeline_en_5.4.2_3.0_1724300619612.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_noun_completion_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_noun_completion_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_noun_completion_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Kartikey95/flan-t5-large-noun-completion-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_qg_test_lq_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_qg_test_lq_v1_en.md new file mode 100644 index 00000000000000..cd84e91e1c05ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_qg_test_lq_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_qg_test_lq_v1 T5Transformer from tarek23 +author: John Snow Labs +name: flan_t5_qg_test_lq_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_qg_test_lq_v1` is a English model originally trained by tarek23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_qg_test_lq_v1_en_5.4.2_3.0_1724364238661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_qg_test_lq_v1_en_5.4.2_3.0_1724364238661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_qg_test_lq_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_qg_test_lq_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_qg_test_lq_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/tarek23/flan-t5-qg-test-LQ-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_qg_test_lq_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_qg_test_lq_v1_pipeline_en.md new file mode 100644 index 00000000000000..5674bedb8d293f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_qg_test_lq_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_qg_test_lq_v1_pipeline pipeline T5Transformer from tarek23 +author: John Snow Labs +name: flan_t5_qg_test_lq_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_qg_test_lq_v1_pipeline` is a English model originally trained by tarek23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_qg_test_lq_v1_pipeline_en_5.4.2_3.0_1724364255742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_qg_test_lq_v1_pipeline_en_5.4.2_3.0_1724364255742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_qg_test_lq_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_qg_test_lq_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_qg_test_lq_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/tarek23/flan-t5-qg-test-LQ-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_all_kongo_w_context_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_all_kongo_w_context_small_en.md new file mode 100644 index 00000000000000..febad37814a3ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_all_kongo_w_context_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_all_kongo_w_context_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_all_kongo_w_context_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_all_kongo_w_context_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_all_kongo_w_context_small_en_5.4.2_3.0_1724329501583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_all_kongo_w_context_small_en_5.4.2_3.0_1724329501583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_all_kongo_w_context_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_all_kongo_w_context_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_all_kongo_w_context_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-all-kg-w-context-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_all_kongo_w_context_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_all_kongo_w_context_small_pipeline_en.md new file mode 100644 index 00000000000000..40080bf7f5e822 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_all_kongo_w_context_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_all_kongo_w_context_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_all_kongo_w_context_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_all_kongo_w_context_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_all_kongo_w_context_small_pipeline_en_5.4.2_3.0_1724329518610.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_all_kongo_w_context_small_pipeline_en_5.4.2_3.0_1724329518610.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_all_kongo_w_context_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_all_kongo_w_context_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_all_kongo_w_context_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-all-kg-w-context-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_direct_w_context_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_direct_w_context_small_en.md new file mode 100644 index 00000000000000..5450dbd745d099 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_direct_w_context_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_direct_w_context_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_direct_w_context_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_direct_w_context_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_small_en_5.4.2_3.0_1724287072647.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_small_en_5.4.2_3.0_1724287072647.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_direct_w_context_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_direct_w_context_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_direct_w_context_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-direct-w-context-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_direct_w_context_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_direct_w_context_small_pipeline_en.md new file mode 100644 index 00000000000000..29bff6084bcf9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_direct_w_context_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_direct_w_context_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_direct_w_context_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_direct_w_context_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_small_pipeline_en_5.4.2_3.0_1724287089363.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_direct_w_context_small_pipeline_en_5.4.2_3.0_1724287089363.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_kongo_direct_w_context_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_kongo_direct_w_context_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_direct_w_context_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-direct-w-context-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_mlm_w_context_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_mlm_w_context_small_en.md new file mode 100644 index 00000000000000..a322b536f37094 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_mlm_w_context_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_mlm_w_context_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_mlm_w_context_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_mlm_w_context_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_mlm_w_context_small_en_5.4.2_3.0_1724350043840.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_mlm_w_context_small_en_5.4.2_3.0_1724350043840.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_mlm_w_context_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_mlm_w_context_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_mlm_w_context_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.5 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-mlm-w-context-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_mlm_w_context_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_mlm_w_context_small_pipeline_en.md new file mode 100644 index 00000000000000..e01a68c13d6815 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_mlm_w_context_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_mlm_w_context_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_mlm_w_context_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_mlm_w_context_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_mlm_w_context_small_pipeline_en_5.4.2_3.0_1724350061598.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_mlm_w_context_small_pipeline_en_5.4.2_3.0_1724350061598.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_kongo_mlm_w_context_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_kongo_mlm_w_context_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_mlm_w_context_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.5 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-mlm-w-context-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_w_context_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_w_context_small_finetuned_en.md new file mode 100644 index 00000000000000..db07b8f6a32dc5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_w_context_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_w_context_small_finetuned T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_w_context_small_finetuned +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_w_context_small_finetuned` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_w_context_small_finetuned_en_5.4.2_3.0_1724303928352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_w_context_small_finetuned_en_5.4.2_3.0_1724303928352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_w_context_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_retacred_kongo_w_context_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_w_context_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-w-context-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_w_context_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_w_context_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..9c6fc2ad3878c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_retacred_kongo_w_context_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_retacred_kongo_w_context_small_finetuned_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_retacred_kongo_w_context_small_finetuned_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_retacred_kongo_w_context_small_finetuned_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_w_context_small_finetuned_pipeline_en_5.4.2_3.0_1724303945143.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_retacred_kongo_w_context_small_finetuned_pipeline_en_5.4.2_3.0_1724303945143.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_retacred_kongo_w_context_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_retacred_kongo_w_context_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_retacred_kongo_w_context_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-retacred-kg-w-context-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_1_cnndm_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_1_cnndm_en.md new file mode 100644 index 00000000000000..7deb1698d42308 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_1_cnndm_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_6_1_cnndm T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_1_cnndm +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_1_cnndm` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_1_cnndm_en_5.4.2_3.0_1724301763150.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_1_cnndm_en_5.4.2_3.0_1724301763150.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_6_1_cnndm","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_6_1_cnndm", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_1_cnndm| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|267.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-1-cnndm \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_1_cnndm_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_1_cnndm_pipeline_en.md new file mode 100644 index 00000000000000..f2b9d699de4b8c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_1_cnndm_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_6_1_cnndm_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_1_cnndm_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_1_cnndm_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_1_cnndm_pipeline_en_5.4.2_3.0_1724301775796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_1_cnndm_pipeline_en_5.4.2_3.0_1724301775796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_6_1_cnndm_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_6_1_cnndm_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_1_cnndm_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|267.3 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-1-cnndm + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_5_xsum_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_5_xsum_en.md new file mode 100644 index 00000000000000..c4bfcb48edd72e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_5_xsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_6_5_xsum T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_5_xsum +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_5_xsum` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_5_xsum_en_5.4.2_3.0_1724318230696.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_5_xsum_en_5.4.2_3.0_1724318230696.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_6_5_xsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_6_5_xsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_5_xsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.2 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-5-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_5_xsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_5_xsum_pipeline_en.md new file mode 100644 index 00000000000000..14722236695137 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_6_5_xsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_6_5_xsum_pipeline pipeline T5Transformer from spacemanidol +author: John Snow Labs +name: flan_t5_small_6_5_xsum_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_6_5_xsum_pipeline` is a English model originally trained by spacemanidol. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_5_xsum_pipeline_en_5.4.2_3.0_1724318246135.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_6_5_xsum_pipeline_en_5.4.2_3.0_1724318246135.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_6_5_xsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_6_5_xsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_6_5_xsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.2 MB| + +## References + +https://huggingface.co/spacemanidol/flan-t5-small-6-5-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_analogy_t_rex_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_analogy_t_rex_en.md new file mode 100644 index 00000000000000..0c190bbbe73096 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_analogy_t_rex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_analogy_t_rex T5Transformer from research-backup +author: John Snow Labs +name: flan_t5_small_analogy_t_rex +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_analogy_t_rex` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_analogy_t_rex_en_5.4.2_3.0_1724366515444.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_analogy_t_rex_en_5.4.2_3.0_1724366515444.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_analogy_t_rex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_analogy_t_rex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_analogy_t_rex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/research-backup/flan-t5-small-analogy-t-rex \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_analogy_t_rex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_analogy_t_rex_pipeline_en.md new file mode 100644 index 00000000000000..896c2822e4086e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_analogy_t_rex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_analogy_t_rex_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: flan_t5_small_analogy_t_rex_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_analogy_t_rex_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_analogy_t_rex_pipeline_en_5.4.2_3.0_1724366532064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_analogy_t_rex_pipeline_en_5.4.2_3.0_1724366532064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_analogy_t_rex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_analogy_t_rex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_analogy_t_rex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/research-backup/flan-t5-small-analogy-t-rex + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t3_f2_prompt_adherence_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t3_f2_prompt_adherence_en.md new file mode 100644 index 00000000000000..401cfc41230a97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t3_f2_prompt_adherence_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_asap_t3_f2_prompt_adherence T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t3_f2_prompt_adherence +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t3_f2_prompt_adherence` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f2_prompt_adherence_en_5.4.2_3.0_1724345051729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f2_prompt_adherence_en_5.4.2_3.0_1724345051729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_asap_t3_f2_prompt_adherence","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_asap_t3_f2_prompt_adherence", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t3_f2_prompt_adherence| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t3_f2_prompt_adherence \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t3_f2_prompt_adherence_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t3_f2_prompt_adherence_pipeline_en.md new file mode 100644 index 00000000000000..cc164b3847c77c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t3_f2_prompt_adherence_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_asap_t3_f2_prompt_adherence_pipeline pipeline T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t3_f2_prompt_adherence_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t3_f2_prompt_adherence_pipeline` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f2_prompt_adherence_pipeline_en_5.4.2_3.0_1724345068376.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t3_f2_prompt_adherence_pipeline_en_5.4.2_3.0_1724345068376.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_asap_t3_f2_prompt_adherence_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_asap_t3_f2_prompt_adherence_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t3_f2_prompt_adherence_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t3_f2_prompt_adherence + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t4_f0_prompt_adherence_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t4_f0_prompt_adherence_en.md new file mode 100644 index 00000000000000..6d9853f06832f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t4_f0_prompt_adherence_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_asap_t4_f0_prompt_adherence T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t4_f0_prompt_adherence +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t4_f0_prompt_adherence` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t4_f0_prompt_adherence_en_5.4.2_3.0_1724347418661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t4_f0_prompt_adherence_en_5.4.2_3.0_1724347418661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_asap_t4_f0_prompt_adherence","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_asap_t4_f0_prompt_adherence", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t4_f0_prompt_adherence| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t4_f0_prompt_adherence \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t4_f0_prompt_adherence_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t4_f0_prompt_adherence_pipeline_en.md new file mode 100644 index 00000000000000..dc58340b161f98 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_asap_t4_f0_prompt_adherence_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_asap_t4_f0_prompt_adherence_pipeline pipeline T5Transformer from salbatarni +author: John Snow Labs +name: flan_t5_small_asap_t4_f0_prompt_adherence_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_asap_t4_f0_prompt_adherence_pipeline` is a English model originally trained by salbatarni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t4_f0_prompt_adherence_pipeline_en_5.4.2_3.0_1724347436945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_asap_t4_f0_prompt_adherence_pipeline_en_5.4.2_3.0_1724347436945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_asap_t4_f0_prompt_adherence_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_asap_t4_f0_prompt_adherence_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_asap_t4_f0_prompt_adherence_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/salbatarni/flan-t5-small-asap_t4_f0_prompt_adherence + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_finetuned_xsum_aryan0310_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_finetuned_xsum_aryan0310_en.md new file mode 100644 index 00000000000000..fea811c68142fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_finetuned_xsum_aryan0310_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_finetuned_xsum_aryan0310 T5Transformer from Aryan0310 +author: John Snow Labs +name: flan_t5_small_finetuned_xsum_aryan0310 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_xsum_aryan0310` is a English model originally trained by Aryan0310. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_aryan0310_en_5.4.2_3.0_1724369772821.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_aryan0310_en_5.4.2_3.0_1724369772821.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_finetuned_xsum_aryan0310","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_finetuned_xsum_aryan0310", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_xsum_aryan0310| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Aryan0310/flan-t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_finetuned_xsum_aryan0310_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_finetuned_xsum_aryan0310_pipeline_en.md new file mode 100644 index 00000000000000..f66842c7b93844 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_finetuned_xsum_aryan0310_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_finetuned_xsum_aryan0310_pipeline pipeline T5Transformer from Aryan0310 +author: John Snow Labs +name: flan_t5_small_finetuned_xsum_aryan0310_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_xsum_aryan0310_pipeline` is a English model originally trained by Aryan0310. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_aryan0310_pipeline_en_5.4.2_3.0_1724369789304.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_aryan0310_pipeline_en_5.4.2_3.0_1724369789304.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_finetuned_xsum_aryan0310_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_finetuned_xsum_aryan0310_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_xsum_aryan0310_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Aryan0310/flan-t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_lamp_4u_finetuned_3_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_lamp_4u_finetuned_3_en.md new file mode 100644 index 00000000000000..d8f11b1c05a053 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_lamp_4u_finetuned_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_lamp_4u_finetuned_3 T5Transformer from abhiman23897 +author: John Snow Labs +name: flan_t5_small_lamp_4u_finetuned_3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_lamp_4u_finetuned_3` is a English model originally trained by abhiman23897. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_lamp_4u_finetuned_3_en_5.4.2_3.0_1724340283305.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_lamp_4u_finetuned_3_en_5.4.2_3.0_1724340283305.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_lamp_4u_finetuned_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_lamp_4u_finetuned_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_lamp_4u_finetuned_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/abhiman23897/flan-t5-small-lamp-4u-finetuned-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_lamp_4u_finetuned_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_lamp_4u_finetuned_3_pipeline_en.md new file mode 100644 index 00000000000000..ac15c217f1603d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_lamp_4u_finetuned_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_lamp_4u_finetuned_3_pipeline pipeline T5Transformer from abhiman23897 +author: John Snow Labs +name: flan_t5_small_lamp_4u_finetuned_3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_lamp_4u_finetuned_3_pipeline` is a English model originally trained by abhiman23897. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_lamp_4u_finetuned_3_pipeline_en_5.4.2_3.0_1724340300661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_lamp_4u_finetuned_3_pipeline_en_5.4.2_3.0_1724340300661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_lamp_4u_finetuned_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_lamp_4u_finetuned_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_lamp_4u_finetuned_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/abhiman23897/flan-t5-small-lamp-4u-finetuned-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_qa_10_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_qa_10_en.md new file mode 100644 index 00000000000000..afaeec7f2bfd79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_qa_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_qa_10 T5Transformer from badokorach +author: John Snow Labs +name: flan_t5_small_qa_10 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_qa_10` is a English model originally trained by badokorach. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_qa_10_en_5.4.2_3.0_1724346191704.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_qa_10_en_5.4.2_3.0_1724346191704.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_qa_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_qa_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_qa_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/badokorach/flan-t5-small-qa-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_qa_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_qa_10_pipeline_en.md new file mode 100644 index 00000000000000..dafb2362b64f91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_qa_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_qa_10_pipeline pipeline T5Transformer from badokorach +author: John Snow Labs +name: flan_t5_small_qa_10_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_qa_10_pipeline` is a English model originally trained by badokorach. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_qa_10_pipeline_en_5.4.2_3.0_1724346207926.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_qa_10_pipeline_en_5.4.2_3.0_1724346207926.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_qa_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_qa_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_qa_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/badokorach/flan-t5-small-qa-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_lsmrn_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_lsmrn_en.md new file mode 100644 index 00000000000000..48784fb09af040 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_lsmrn_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_lsmrn T5Transformer from lsmrn +author: John Snow Labs +name: flan_t5_small_samsum_lsmrn +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_lsmrn` is a English model originally trained by lsmrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_lsmrn_en_5.4.2_3.0_1724331076728.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_lsmrn_en_5.4.2_3.0_1724331076728.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_lsmrn","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_lsmrn", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_lsmrn| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/lsmrn/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_lsmrn_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_lsmrn_pipeline_en.md new file mode 100644 index 00000000000000..826f787d766ca3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_lsmrn_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_lsmrn_pipeline pipeline T5Transformer from lsmrn +author: John Snow Labs +name: flan_t5_small_samsum_lsmrn_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_lsmrn_pipeline` is a English model originally trained by lsmrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_lsmrn_pipeline_en_5.4.2_3.0_1724331093628.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_lsmrn_pipeline_en_5.4.2_3.0_1724331093628.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_lsmrn_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_lsmrn_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_lsmrn_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/lsmrn/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_petrovilija_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_petrovilija_en.md new file mode 100644 index 00000000000000..5f1fd3f3bed3c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_petrovilija_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_petrovilija T5Transformer from Petrovilija +author: John Snow Labs +name: flan_t5_small_samsum_petrovilija +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_petrovilija` is a English model originally trained by Petrovilija. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_petrovilija_en_5.4.2_3.0_1724348885290.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_petrovilija_en_5.4.2_3.0_1724348885290.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_petrovilija","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_petrovilija", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_petrovilija| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Petrovilija/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_petrovilija_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_petrovilija_pipeline_en.md new file mode 100644 index 00000000000000..4ac3d5f0c809b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_samsum_petrovilija_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_petrovilija_pipeline pipeline T5Transformer from Petrovilija +author: John Snow Labs +name: flan_t5_small_samsum_petrovilija_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_petrovilija_pipeline` is a English model originally trained by Petrovilija. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_petrovilija_pipeline_en_5.4.2_3.0_1724348902031.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_petrovilija_pipeline_en_5.4.2_3.0_1724348902031.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_petrovilija_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_petrovilija_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_petrovilija_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Petrovilija/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_squad_ae_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_squad_ae_pipeline_en.md new file mode 100644 index 00000000000000..4497b7d5dd8700 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_squad_ae_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_squad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: flan_t5_small_squad_ae_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_squad_ae_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_squad_ae_pipeline_en_5.4.2_3.0_1724320004672.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_squad_ae_pipeline_en_5.4.2_3.0_1724320004672.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_squad_ae_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_squad_ae_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_squad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/lmqg/flan-t5-small-squad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_tweet_qg_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_tweet_qg_en.md new file mode 100644 index 00000000000000..78e5779a4c163a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_tweet_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_tweet_qg T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_small_tweet_qg +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_tweet_qg` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_tweet_qg_en_5.4.2_3.0_1724288821695.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_tweet_qg_en_5.4.2_3.0_1724288821695.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_tweet_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_tweet_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_tweet_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-small-tweet-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_tweet_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_tweet_qg_pipeline_en.md new file mode 100644 index 00000000000000..7c870d02a0f57c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_tweet_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_tweet_qg_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_small_tweet_qg_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_tweet_qg_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_tweet_qg_pipeline_en_5.4.2_3.0_1724288838086.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_tweet_qg_pipeline_en_5.4.2_3.0_1724288838086.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_tweet_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_tweet_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_tweet_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-small-tweet-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_vigneshsundaram1006_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_vigneshsundaram1006_en.md new file mode 100644 index 00000000000000..b35b3ff05e9a20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_vigneshsundaram1006_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_vigneshsundaram1006 T5Transformer from Vigneshsundaram1006 +author: John Snow Labs +name: flan_t5_small_vigneshsundaram1006 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_vigneshsundaram1006` is a English model originally trained by Vigneshsundaram1006. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_vigneshsundaram1006_en_5.4.2_3.0_1724309404224.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_vigneshsundaram1006_en_5.4.2_3.0_1724309404224.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_vigneshsundaram1006","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_vigneshsundaram1006", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_vigneshsundaram1006| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Vigneshsundaram1006/flan-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_vigneshsundaram1006_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_vigneshsundaram1006_pipeline_en.md new file mode 100644 index 00000000000000..1a38607623c0f1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flan_t5_small_vigneshsundaram1006_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_vigneshsundaram1006_pipeline pipeline T5Transformer from Vigneshsundaram1006 +author: John Snow Labs +name: flan_t5_small_vigneshsundaram1006_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_vigneshsundaram1006_pipeline` is a English model originally trained by Vigneshsundaram1006. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_vigneshsundaram1006_pipeline_en_5.4.2_3.0_1724309420483.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_vigneshsundaram1006_pipeline_en_5.4.2_3.0_1724309420483.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_vigneshsundaram1006_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_vigneshsundaram1006_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_vigneshsundaram1006_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Vigneshsundaram1006/flan-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flant5_base_dtruong46me_en.md b/docs/_posts/ahmedlone127/2024-08-22-flant5_base_dtruong46me_en.md new file mode 100644 index 00000000000000..f4df95adf05086 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flant5_base_dtruong46me_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5_base_dtruong46me T5Transformer from dtruong46me +author: John Snow Labs +name: flant5_base_dtruong46me +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_base_dtruong46me` is a English model originally trained by dtruong46me. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_base_dtruong46me_en_5.4.2_3.0_1724314611949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_base_dtruong46me_en_5.4.2_3.0_1724314611949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_base_dtruong46me","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_base_dtruong46me", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_base_dtruong46me| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dtruong46me/flant5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flant5_base_dtruong46me_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flant5_base_dtruong46me_pipeline_en.md new file mode 100644 index 00000000000000..690bf5b1ca7e3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flant5_base_dtruong46me_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5_base_dtruong46me_pipeline pipeline T5Transformer from dtruong46me +author: John Snow Labs +name: flant5_base_dtruong46me_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_base_dtruong46me_pipeline` is a English model originally trained by dtruong46me. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_base_dtruong46me_pipeline_en_5.4.2_3.0_1724314659682.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_base_dtruong46me_pipeline_en_5.4.2_3.0_1724314659682.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_base_dtruong46me_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_base_dtruong46me_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_base_dtruong46me_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dtruong46me/flant5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flant5_financial_sentiment_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-22-flant5_financial_sentiment_finetuned_en.md new file mode 100644 index 00000000000000..8842cecd5cb0bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flant5_financial_sentiment_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5_financial_sentiment_finetuned T5Transformer from steve1989 +author: John Snow Labs +name: flant5_financial_sentiment_finetuned +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_financial_sentiment_finetuned` is a English model originally trained by steve1989. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_financial_sentiment_finetuned_en_5.4.2_3.0_1724287381066.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_financial_sentiment_finetuned_en_5.4.2_3.0_1724287381066.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_financial_sentiment_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_financial_sentiment_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_financial_sentiment_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/steve1989/FlanT5_financial_Sentiment_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flant5_financial_sentiment_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flant5_financial_sentiment_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..50104dc9f71f86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flant5_financial_sentiment_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5_financial_sentiment_finetuned_pipeline pipeline T5Transformer from steve1989 +author: John Snow Labs +name: flant5_financial_sentiment_finetuned_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_financial_sentiment_finetuned_pipeline` is a English model originally trained by steve1989. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_financial_sentiment_finetuned_pipeline_en_5.4.2_3.0_1724287429409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_financial_sentiment_finetuned_pipeline_en_5.4.2_3.0_1724287429409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_financial_sentiment_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_financial_sentiment_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_financial_sentiment_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/steve1989/FlanT5_financial_Sentiment_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flant5_offensive_german_english_en.md b/docs/_posts/ahmedlone127/2024-08-22-flant5_offensive_german_english_en.md new file mode 100644 index 00000000000000..d5d043c6b0cc1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flant5_offensive_german_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5_offensive_german_english T5Transformer from JenniferHJF +author: John Snow Labs +name: flant5_offensive_german_english +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_offensive_german_english` is a English model originally trained by JenniferHJF. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_offensive_german_english_en_5.4.2_3.0_1724300111028.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_offensive_german_english_en_5.4.2_3.0_1724300111028.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5_offensive_german_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5_offensive_german_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_offensive_german_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JenniferHJF/flant5_offensive_german_english \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flant5_offensive_german_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flant5_offensive_german_english_pipeline_en.md new file mode 100644 index 00000000000000..5485a062f63795 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flant5_offensive_german_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5_offensive_german_english_pipeline pipeline T5Transformer from JenniferHJF +author: John Snow Labs +name: flant5_offensive_german_english_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5_offensive_german_english_pipeline` is a English model originally trained by JenniferHJF. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5_offensive_german_english_pipeline_en_5.4.2_3.0_1724300158327.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5_offensive_german_english_pipeline_en_5.4.2_3.0_1724300158327.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5_offensive_german_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5_offensive_german_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5_offensive_german_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/JenniferHJF/flant5_offensive_german_english + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flant5base_instraction1500000_10epoch_50batch_128len_en.md b/docs/_posts/ahmedlone127/2024-08-22-flant5base_instraction1500000_10epoch_50batch_128len_en.md new file mode 100644 index 00000000000000..5d43cce5028851 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flant5base_instraction1500000_10epoch_50batch_128len_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flant5base_instraction1500000_10epoch_50batch_128len T5Transformer from shiontendon +author: John Snow Labs +name: flant5base_instraction1500000_10epoch_50batch_128len +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5base_instraction1500000_10epoch_50batch_128len` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5base_instraction1500000_10epoch_50batch_128len_en_5.4.2_3.0_1724326643525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5base_instraction1500000_10epoch_50batch_128len_en_5.4.2_3.0_1724326643525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flant5base_instraction1500000_10epoch_50batch_128len","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flant5base_instraction1500000_10epoch_50batch_128len", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5base_instraction1500000_10epoch_50batch_128len| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shiontendon/FlanT5base_instraction1500000_10epoch_50batch_128len \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-flant5base_instraction1500000_10epoch_50batch_128len_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-flant5base_instraction1500000_10epoch_50batch_128len_pipeline_en.md new file mode 100644 index 00000000000000..e8e60ff6f5c5a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-flant5base_instraction1500000_10epoch_50batch_128len_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flant5base_instraction1500000_10epoch_50batch_128len_pipeline pipeline T5Transformer from shiontendon +author: John Snow Labs +name: flant5base_instraction1500000_10epoch_50batch_128len_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flant5base_instraction1500000_10epoch_50batch_128len_pipeline` is a English model originally trained by shiontendon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flant5base_instraction1500000_10epoch_50batch_128len_pipeline_en_5.4.2_3.0_1724326692577.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flant5base_instraction1500000_10epoch_50batch_128len_pipeline_en_5.4.2_3.0_1724326692577.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flant5base_instraction1500000_10epoch_50batch_128len_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flant5base_instraction1500000_10epoch_50batch_128len_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flant5base_instraction1500000_10epoch_50batch_128len_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/shiontendon/FlanT5base_instraction1500000_10epoch_50batch_128len + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-formal_informal_en.md b/docs/_posts/ahmedlone127/2024-08-22-formal_informal_en.md new file mode 100644 index 00000000000000..25484c0207ac71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-formal_informal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English formal_informal T5Transformer from HARSHU550 +author: John Snow Labs +name: formal_informal +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`formal_informal` is a English model originally trained by HARSHU550. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/formal_informal_en_5.4.2_3.0_1724316467243.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/formal_informal_en_5.4.2_3.0_1724316467243.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("formal_informal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("formal_informal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|formal_informal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/HARSHU550/Formal_Informal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-formal_informal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-formal_informal_pipeline_en.md new file mode 100644 index 00000000000000..b63120f3537e28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-formal_informal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English formal_informal_pipeline pipeline T5Transformer from HARSHU550 +author: John Snow Labs +name: formal_informal_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`formal_informal_pipeline` is a English model originally trained by HARSHU550. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/formal_informal_pipeline_en_5.4.2_3.0_1724316517081.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/formal_informal_pipeline_en_5.4.2_3.0_1724316517081.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("formal_informal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("formal_informal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|formal_informal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/HARSHU550/Formal_Informal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-french_all_en.md b/docs/_posts/ahmedlone127/2024-08-22-french_all_en.md new file mode 100644 index 00000000000000..cd2b98916bb7ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-french_all_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English french_all T5Transformer from Bistolero +author: John Snow Labs +name: french_all +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`french_all` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/french_all_en_5.4.2_3.0_1724328920903.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/french_all_en_5.4.2_3.0_1724328920903.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("french_all","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("french_all", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|french_all| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Bistolero/french_all \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-french_all_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-french_all_pipeline_en.md new file mode 100644 index 00000000000000..0684cae94cfa36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-french_all_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English french_all_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: french_all_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`french_all_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/french_all_pipeline_en_5.4.2_3.0_1724329094008.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/french_all_pipeline_en_5.4.2_3.0_1724329094008.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("french_all_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("french_all_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|french_all_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Bistolero/french_all + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ft_aeroqa_1hop_c4_aviationtriples_unverb_20_en.md b/docs/_posts/ahmedlone127/2024-08-22-ft_aeroqa_1hop_c4_aviationtriples_unverb_20_en.md new file mode 100644 index 00000000000000..feb36071c6df07 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ft_aeroqa_1hop_c4_aviationtriples_unverb_20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ft_aeroqa_1hop_c4_aviationtriples_unverb_20 T5Transformer from sakharamg +author: John Snow Labs +name: ft_aeroqa_1hop_c4_aviationtriples_unverb_20 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aeroqa_1hop_c4_aviationtriples_unverb_20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_c4_aviationtriples_unverb_20_en_5.4.2_3.0_1724352923269.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_c4_aviationtriples_unverb_20_en_5.4.2_3.0_1724352923269.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ft_aeroqa_1hop_c4_aviationtriples_unverb_20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ft_aeroqa_1hop_c4_aviationtriples_unverb_20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aeroqa_1hop_c4_aviationtriples_unverb_20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aeroqa_1hop_c4_aviationtriples_unverb_20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline_en.md new file mode 100644 index 00000000000000..4917a464af7f96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline_en_5.4.2_3.0_1724353061086.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline_en_5.4.2_3.0_1724353061086.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ft_aeroqa_1hop_c4_aviationtriples_unverb_20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/FT_aeroqa_1hop_c4_aviationtriples_unverb_20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ge_dutch_64b_25k_en.md b/docs/_posts/ahmedlone127/2024-08-22-ge_dutch_64b_25k_en.md new file mode 100644 index 00000000000000..5b78875da90768 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ge_dutch_64b_25k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ge_dutch_64b_25k T5Transformer from Bistolero +author: John Snow Labs +name: ge_dutch_64b_25k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ge_dutch_64b_25k` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ge_dutch_64b_25k_en_5.4.2_3.0_1724323318576.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ge_dutch_64b_25k_en_5.4.2_3.0_1724323318576.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ge_dutch_64b_25k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ge_dutch_64b_25k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ge_dutch_64b_25k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/ge_nl_64B_25K \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ge_dutch_64b_25k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-ge_dutch_64b_25k_pipeline_en.md new file mode 100644 index 00000000000000..16f4479cd8005f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ge_dutch_64b_25k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ge_dutch_64b_25k_pipeline pipeline T5Transformer from Bistolero +author: John Snow Labs +name: ge_dutch_64b_25k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ge_dutch_64b_25k_pipeline` is a English model originally trained by Bistolero. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ge_dutch_64b_25k_pipeline_en_5.4.2_3.0_1724323487592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ge_dutch_64b_25k_pipeline_en_5.4.2_3.0_1724323487592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ge_dutch_64b_25k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ge_dutch_64b_25k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ge_dutch_64b_25k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Bistolero/ge_nl_64B_25K + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-gen_qm_17_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-gen_qm_17_small_en.md new file mode 100644 index 00000000000000..d146bc042b6370 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-gen_qm_17_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English gen_qm_17_small T5Transformer from dkuntso +author: John Snow Labs +name: gen_qm_17_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gen_qm_17_small` is a English model originally trained by dkuntso. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gen_qm_17_small_en_5.4.2_3.0_1724323504057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gen_qm_17_small_en_5.4.2_3.0_1724323504057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("gen_qm_17_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("gen_qm_17_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gen_qm_17_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|313.2 MB| + +## References + +https://huggingface.co/dkuntso/gen-qm-17-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-gen_qm_17_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-gen_qm_17_small_pipeline_en.md new file mode 100644 index 00000000000000..cbcd081ab8714d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-gen_qm_17_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English gen_qm_17_small_pipeline pipeline T5Transformer from dkuntso +author: John Snow Labs +name: gen_qm_17_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gen_qm_17_small_pipeline` is a English model originally trained by dkuntso. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gen_qm_17_small_pipeline_en_5.4.2_3.0_1724323522748.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gen_qm_17_small_pipeline_en_5.4.2_3.0_1724323522748.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("gen_qm_17_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("gen_qm_17_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gen_qm_17_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|313.2 MB| + +## References + +https://huggingface.co/dkuntso/gen-qm-17-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-gomoku_t5_en.md b/docs/_posts/ahmedlone127/2024-08-22-gomoku_t5_en.md new file mode 100644 index 00000000000000..e3e218bd0d4dd1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-gomoku_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English gomoku_t5 T5Transformer from rymaju +author: John Snow Labs +name: gomoku_t5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gomoku_t5` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gomoku_t5_en_5.4.2_3.0_1724340347711.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gomoku_t5_en_5.4.2_3.0_1724340347711.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("gomoku_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("gomoku_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gomoku_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.5 MB| + +## References + +https://huggingface.co/rymaju/gomoku-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-gomoku_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-gomoku_t5_pipeline_en.md new file mode 100644 index 00000000000000..47667279c68344 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-gomoku_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English gomoku_t5_pipeline pipeline T5Transformer from rymaju +author: John Snow Labs +name: gomoku_t5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`gomoku_t5_pipeline` is a English model originally trained by rymaju. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/gomoku_t5_pipeline_en_5.4.2_3.0_1724340372671.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/gomoku_t5_pipeline_en_5.4.2_3.0_1724340372671.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("gomoku_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("gomoku_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|gomoku_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.5 MB| + +## References + +https://huggingface.co/rymaju/gomoku-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-happy_transformer_t5_base_grammar_correction_bosnian_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-happy_transformer_t5_base_grammar_correction_bosnian_v1_en.md new file mode 100644 index 00000000000000..1946f48e806e5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-happy_transformer_t5_base_grammar_correction_bosnian_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English happy_transformer_t5_base_grammar_correction_bosnian_v1 T5Transformer from hafidikhsan +author: John Snow Labs +name: happy_transformer_t5_base_grammar_correction_bosnian_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`happy_transformer_t5_base_grammar_correction_bosnian_v1` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_bosnian_v1_en_5.4.2_3.0_1724298184676.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_bosnian_v1_en_5.4.2_3.0_1724298184676.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("happy_transformer_t5_base_grammar_correction_bosnian_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("happy_transformer_t5_base_grammar_correction_bosnian_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|happy_transformer_t5_base_grammar_correction_bosnian_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hafidikhsan/happy-transformer-t5-base-grammar-correction-bs-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline_en.md new file mode 100644 index 00000000000000..298daa5959c6dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline pipeline T5Transformer from hafidikhsan +author: John Snow Labs +name: happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline_en_5.4.2_3.0_1724298233808.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline_en_5.4.2_3.0_1724298233808.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|happy_transformer_t5_base_grammar_correction_bosnian_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hafidikhsan/happy-transformer-t5-base-grammar-correction-bs-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-imdb_t5_small_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-22-imdb_t5_small_seed_3_en.md new file mode 100644 index 00000000000000..5e4b51094671e4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-imdb_t5_small_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English imdb_t5_small_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_small_seed_3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_small_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_small_seed_3_en_5.4.2_3.0_1724359938113.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_small_seed_3_en_5.4.2_3.0_1724359938113.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("imdb_t5_small_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("imdb_t5_small_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_small_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.5 MB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-small_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-imdb_t5_small_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-imdb_t5_small_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..b5f4f75965ae36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-imdb_t5_small_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English imdb_t5_small_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: imdb_t5_small_seed_3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`imdb_t5_small_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/imdb_t5_small_seed_3_pipeline_en_5.4.2_3.0_1724359959553.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/imdb_t5_small_seed_3_pipeline_en_5.4.2_3.0_1724359959553.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("imdb_t5_small_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("imdb_t5_small_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|imdb_t5_small_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.5 MB| + +## References + +https://huggingface.co/utahnlp/imdb_t5-small_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-indonesian_end2end_qag_flan_t5_en.md b/docs/_posts/ahmedlone127/2024-08-22-indonesian_end2end_qag_flan_t5_en.md new file mode 100644 index 00000000000000..25ef8529a6743b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-indonesian_end2end_qag_flan_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English indonesian_end2end_qag_flan_t5 T5Transformer from adirizq +author: John Snow Labs +name: indonesian_end2end_qag_flan_t5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`indonesian_end2end_qag_flan_t5` is a English model originally trained by adirizq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/indonesian_end2end_qag_flan_t5_en_5.4.2_3.0_1724329384440.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/indonesian_end2end_qag_flan_t5_en_5.4.2_3.0_1724329384440.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("indonesian_end2end_qag_flan_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("indonesian_end2end_qag_flan_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|indonesian_end2end_qag_flan_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/adirizq/indonesian-end2end-qag-flan-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-indonesian_end2end_qag_flan_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-indonesian_end2end_qag_flan_t5_pipeline_en.md new file mode 100644 index 00000000000000..f83034b57bcbb8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-indonesian_end2end_qag_flan_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English indonesian_end2end_qag_flan_t5_pipeline pipeline T5Transformer from adirizq +author: John Snow Labs +name: indonesian_end2end_qag_flan_t5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`indonesian_end2end_qag_flan_t5_pipeline` is a English model originally trained by adirizq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/indonesian_end2end_qag_flan_t5_pipeline_en_5.4.2_3.0_1724329401500.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/indonesian_end2end_qag_flan_t5_pipeline_en_5.4.2_3.0_1724329401500.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("indonesian_end2end_qag_flan_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("indonesian_end2end_qag_flan_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|indonesian_end2end_qag_flan_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/adirizq/indonesian-end2end-qag-flan-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-inverse_gec_en.md b/docs/_posts/ahmedlone127/2024-08-22-inverse_gec_en.md new file mode 100644 index 00000000000000..b0e5a2ef0413a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-inverse_gec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English inverse_gec T5Transformer from mika5883 +author: John Snow Labs +name: inverse_gec +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`inverse_gec` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/inverse_gec_en_5.4.2_3.0_1724338168703.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/inverse_gec_en_5.4.2_3.0_1724338168703.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("inverse_gec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("inverse_gec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|inverse_gec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/inverse_gec \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-inverse_gec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-inverse_gec_pipeline_en.md new file mode 100644 index 00000000000000..796ad8d63ff246 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-inverse_gec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English inverse_gec_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: inverse_gec_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`inverse_gec_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/inverse_gec_pipeline_en_5.4.2_3.0_1724338216106.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/inverse_gec_pipeline_en_5.4.2_3.0_1724338216106.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("inverse_gec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("inverse_gec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|inverse_gec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/inverse_gec + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_en.md b/docs/_posts/ahmedlone127/2024-08-22-joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_en.md new file mode 100644 index 00000000000000..309befc2b3ed45 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English joint_turkmen_instruct_base_def_sayula_popoluca_restaurants T5Transformer from kevinscaria +author: John Snow Labs +name: joint_turkmen_instruct_base_def_sayula_popoluca_restaurants +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`joint_turkmen_instruct_base_def_sayula_popoluca_restaurants` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_en_5.4.2_3.0_1724290884846.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_en_5.4.2_3.0_1724290884846.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("joint_turkmen_instruct_base_def_sayula_popoluca_restaurants","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("joint_turkmen_instruct_base_def_sayula_popoluca_restaurants", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|joint_turkmen_instruct_base_def_sayula_popoluca_restaurants| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|947.5 MB| + +## References + +https://huggingface.co/kevinscaria/joint_tk-instruct-base-def-pos-restaurants \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en.md new file mode 100644 index 00000000000000..511d16240f3dd0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline pipeline T5Transformer from kevinscaria +author: John Snow Labs +name: joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline` is a English model originally trained by kevinscaria. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en_5.4.2_3.0_1724290935835.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline_en_5.4.2_3.0_1724290935835.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|joint_turkmen_instruct_base_def_sayula_popoluca_restaurants_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|947.5 MB| + +## References + +https://huggingface.co/kevinscaria/joint_tk-instruct-base-def-pos-restaurants + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-k2t_5_msrvtt_en.md b/docs/_posts/ahmedlone127/2024-08-22-k2t_5_msrvtt_en.md new file mode 100644 index 00000000000000..8c11b83afb4216 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-k2t_5_msrvtt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_5_msrvtt T5Transformer from taewhan +author: John Snow Labs +name: k2t_5_msrvtt +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_5_msrvtt` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_5_msrvtt_en_5.4.2_3.0_1724291432917.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_5_msrvtt_en_5.4.2_3.0_1724291432917.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_5_msrvtt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_5_msrvtt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_5_msrvtt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.9 MB| + +## References + +https://huggingface.co/taewhan/k2t-5_msrvtt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-k2t_5_msrvtt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-k2t_5_msrvtt_pipeline_en.md new file mode 100644 index 00000000000000..c495f83dac8771 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-k2t_5_msrvtt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_5_msrvtt_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_5_msrvtt_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_5_msrvtt_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_5_msrvtt_pipeline_en_5.4.2_3.0_1724291452152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_5_msrvtt_pipeline_en_5.4.2_3.0_1724291452152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_5_msrvtt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_5_msrvtt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_5_msrvtt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.9 MB| + +## References + +https://huggingface.co/taewhan/k2t-5_msrvtt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-k2t_top3_msrvtt_2_lr_8_en.md b/docs/_posts/ahmedlone127/2024-08-22-k2t_top3_msrvtt_2_lr_8_en.md new file mode 100644 index 00000000000000..075acdb860c745 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-k2t_top3_msrvtt_2_lr_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_top3_msrvtt_2_lr_8 T5Transformer from taewhan +author: John Snow Labs +name: k2t_top3_msrvtt_2_lr_8 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_top3_msrvtt_2_lr_8` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_top3_msrvtt_2_lr_8_en_5.4.2_3.0_1724287775930.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_top3_msrvtt_2_lr_8_en_5.4.2_3.0_1724287775930.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_top3_msrvtt_2_lr_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_top3_msrvtt_2_lr_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_top3_msrvtt_2_lr_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.8 MB| + +## References + +https://huggingface.co/taewhan/k2t-top3_msrvtt_2_lr_8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-k2t_top3_msrvtt_2_lr_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-k2t_top3_msrvtt_2_lr_8_pipeline_en.md new file mode 100644 index 00000000000000..11bbc8dc4681ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-k2t_top3_msrvtt_2_lr_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_top3_msrvtt_2_lr_8_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_top3_msrvtt_2_lr_8_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_top3_msrvtt_2_lr_8_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_top3_msrvtt_2_lr_8_pipeline_en_5.4.2_3.0_1724287797281.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_top3_msrvtt_2_lr_8_pipeline_en_5.4.2_3.0_1724287797281.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_top3_msrvtt_2_lr_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_top3_msrvtt_2_lr_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_top3_msrvtt_2_lr_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.8 MB| + +## References + +https://huggingface.co/taewhan/k2t-top3_msrvtt_2_lr_8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_en.md b/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_en.md new file mode 100644 index 00000000000000..e6e2eed1e39b49 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ke_t5_base_aihub T5Transformer from chunwoolee0 +author: John Snow Labs +name: ke_t5_base_aihub +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ke_t5_base_aihub` is a English model originally trained by chunwoolee0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_en_5.4.2_3.0_1724327207951.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_en_5.4.2_3.0_1724327207951.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ke_t5_base_aihub","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ke_t5_base_aihub", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ke_t5_base_aihub| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|663.5 MB| + +## References + +https://huggingface.co/chunwoolee0/ke_t5_base_aihub \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_en.md b/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_en.md new file mode 100644 index 00000000000000..f1a2292a0bb348 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1 T5Transformer from datasciathlete +author: John Snow Labs +name: ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1` is a English model originally trained by datasciathlete. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_en_5.4.2_3.0_1724309987512.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_en_5.4.2_3.0_1724309987512.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/datasciathlete/ke-t5-base-aihub-nmt-short-bs8-lr1e4-wd001-e1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline_en.md new file mode 100644 index 00000000000000..6a45949f48485a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline pipeline T5Transformer from datasciathlete +author: John Snow Labs +name: ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline` is a English model originally trained by datasciathlete. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline_en_5.4.2_3.0_1724310045584.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline_en_5.4.2_3.0_1724310045584.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ke_t5_base_aihub_nmt_short_bs8_lr1e4_wd001_e1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/datasciathlete/ke-t5-base-aihub-nmt-short-bs8-lr1e4-wd001-e1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_pipeline_en.md new file mode 100644 index 00000000000000..07b97c5bd410e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-ke_t5_base_aihub_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ke_t5_base_aihub_pipeline pipeline T5Transformer from chunwoolee0 +author: John Snow Labs +name: ke_t5_base_aihub_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ke_t5_base_aihub_pipeline` is a English model originally trained by chunwoolee0. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_pipeline_en_5.4.2_3.0_1724327433148.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ke_t5_base_aihub_pipeline_en_5.4.2_3.0_1724327433148.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ke_t5_base_aihub_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ke_t5_base_aihub_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ke_t5_base_aihub_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|663.5 MB| + +## References + +https://huggingface.co/chunwoolee0/ke_t5_base_aihub + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kgt5v2_small_wikidata5m_en.md b/docs/_posts/ahmedlone127/2024-08-22-kgt5v2_small_wikidata5m_en.md new file mode 100644 index 00000000000000..d58a574a6bf42e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kgt5v2_small_wikidata5m_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kgt5v2_small_wikidata5m T5Transformer from apoorvumang +author: John Snow Labs +name: kgt5v2_small_wikidata5m +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kgt5v2_small_wikidata5m` is a English model originally trained by apoorvumang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kgt5v2_small_wikidata5m_en_5.4.2_3.0_1724339157982.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kgt5v2_small_wikidata5m_en_5.4.2_3.0_1724339157982.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kgt5v2_small_wikidata5m","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kgt5v2_small_wikidata5m", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kgt5v2_small_wikidata5m| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/apoorvumang/kgt5v2-small-wikidata5m \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kgt5v2_small_wikidata5m_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-kgt5v2_small_wikidata5m_pipeline_en.md new file mode 100644 index 00000000000000..6af0c49daca606 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kgt5v2_small_wikidata5m_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kgt5v2_small_wikidata5m_pipeline pipeline T5Transformer from apoorvumang +author: John Snow Labs +name: kgt5v2_small_wikidata5m_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kgt5v2_small_wikidata5m_pipeline` is a English model originally trained by apoorvumang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kgt5v2_small_wikidata5m_pipeline_en_5.4.2_3.0_1724339175440.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kgt5v2_small_wikidata5m_pipeline_en_5.4.2_3.0_1724339175440.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kgt5v2_small_wikidata5m_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kgt5v2_small_wikidata5m_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kgt5v2_small_wikidata5m_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/apoorvumang/kgt5v2-small-wikidata5m + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_osapl_v5_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_osapl_v5_en.md new file mode 100644 index 00000000000000..90caffd47362fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_osapl_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_osapl_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_osapl_v5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_osapl_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_osapl_v5_en_5.4.2_3.0_1724362221558.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_osapl_v5_en_5.4.2_3.0_1724362221558.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_osapl_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_osapl_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_osapl_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OSAPL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_osapl_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_osapl_v5_pipeline_en.md new file mode 100644 index 00000000000000..5e35dda3aae9a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_osapl_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_osapl_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_osapl_v5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_osapl_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_osapl_v5_pipeline_en_5.4.2_3.0_1724362407250.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_osapl_v5_pipeline_en_5.4.2_3.0_1724362407250.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_osapl_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_osapl_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_osapl_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OSAPL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_posal_v5_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_posal_v5_en.md new file mode 100644 index 00000000000000..25320c358cc6c1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_posal_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_posal_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_posal_v5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_posal_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_v5_en_5.4.2_3.0_1724330250567.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_v5_en_5.4.2_3.0_1724330250567.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_posal_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_posal_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_posal_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POSAL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_posal_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_posal_v5_pipeline_en.md new file mode 100644 index 00000000000000..990aedfdb09e71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_posal_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_posal_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_posal_v5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_posal_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_v5_pipeline_en_5.4.2_3.0_1724330425844.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_posal_v5_pipeline_en_5.4.2_3.0_1724330425844.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_posal_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_posal_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_posal_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_POSAL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_psaol_v5_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_psaol_v5_en.md new file mode 100644 index 00000000000000..2f2c89103d67df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_psaol_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_psaol_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_psaol_v5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_psaol_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psaol_v5_en_5.4.2_3.0_1724331650510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psaol_v5_en_5.4.2_3.0_1724331650510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_psaol_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_psaol_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_psaol_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PSAOL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_psaol_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_psaol_v5_pipeline_en.md new file mode 100644 index 00000000000000..7c5c0304351e59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_psaol_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_psaol_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_psaol_v5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_psaol_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psaol_v5_pipeline_en_5.4.2_3.0_1724331836891.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_psaol_v5_pipeline_en_5.4.2_3.0_1724331836891.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_psaol_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_psaol_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_psaol_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PSAOL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_spoal_v3_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_spoal_v3_en.md new file mode 100644 index 00000000000000..9b6cf91019d8d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_spoal_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_spoal_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_spoal_v3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_spoal_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_spoal_v3_en_5.4.2_3.0_1724297907539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_spoal_v3_en_5.4.2_3.0_1724297907539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_spoal_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_spoal_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_spoal_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_SPOAL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_asopl_v3_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_asopl_v3_en.md new file mode 100644 index 00000000000000..72174057a44d1b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_asopl_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_asopl_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_asopl_v3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_asopl_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_asopl_v3_en_5.4.2_3.0_1724367140352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_asopl_v3_en_5.4.2_3.0_1724367140352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_asopl_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_asopl_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_asopl_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_ASOPL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_aspol_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_aspol_v2_en.md new file mode 100644 index 00000000000000..25791c2bbd0824 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_aspol_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_aspol_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_aspol_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_aspol_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_aspol_v2_en_5.4.2_3.0_1724306952878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_aspol_v2_en_5.4.2_3.0_1724306952878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_aspol_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_aspol_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_aspol_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_ASPOL_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_poasl_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_poasl_en.md new file mode 100644 index 00000000000000..2f76d49edd09e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_poasl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_poasl T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_poasl +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_poasl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_poasl_en_5.4.2_3.0_1724326438764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_poasl_en_5.4.2_3.0_1724326438764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_poasl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_poasl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_poasl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_POASL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_poasl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_poasl_pipeline_en.md new file mode 100644 index 00000000000000..b17b7d20251208 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-kltn_coqe_vit5_total_poasl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_poasl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_poasl_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_poasl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_poasl_pipeline_en_5.4.2_3.0_1724326606467.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_poasl_pipeline_en_5.4.2_3.0_1724326606467.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_poasl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_poasl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_poasl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_POASL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-korean_0619_en.md b/docs/_posts/ahmedlone127/2024-08-22-korean_0619_en.md new file mode 100644 index 00000000000000..f29c4eecc4cd55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-korean_0619_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English korean_0619 T5Transformer from KoooK +author: John Snow Labs +name: korean_0619 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`korean_0619` is a English model originally trained by KoooK. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/korean_0619_en_5.4.2_3.0_1724346275425.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/korean_0619_en_5.4.2_3.0_1724346275425.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("korean_0619","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("korean_0619", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|korean_0619| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/KoooK/ko_0619 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-korean_0619_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-korean_0619_pipeline_en.md new file mode 100644 index 00000000000000..f54e8c1d71303b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-korean_0619_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English korean_0619_pipeline pipeline T5Transformer from KoooK +author: John Snow Labs +name: korean_0619_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`korean_0619_pipeline` is a English model originally trained by KoooK. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/korean_0619_pipeline_en_5.4.2_3.0_1724346322063.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/korean_0619_pipeline_en_5.4.2_3.0_1724346322063.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("korean_0619_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("korean_0619_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|korean_0619_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/KoooK/ko_0619 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_large_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_large_en.md new file mode 100644 index 00000000000000..9545a34ac53702 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_large T5Transformer from Ashreen +author: John Snow Labs +name: legal_t5_large +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_large` is a English model originally trained by Ashreen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_large_en_5.4.2_3.0_1724321673987.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_large_en_5.4.2_3.0_1724321673987.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Ashreen/legal-t5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_large_pipeline_en.md new file mode 100644 index 00000000000000..17cb9caaab7177 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_large_pipeline pipeline T5Transformer from Ashreen +author: John Snow Labs +name: legal_t5_large_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_large_pipeline` is a English model originally trained by Ashreen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_large_pipeline_en_5.4.2_3.0_1724321806564.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_large_pipeline_en_5.4.2_3.0_1724321806564.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Ashreen/legal-t5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_finetuned_summ_german_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_finetuned_summ_german_en.md new file mode 100644 index 00000000000000..42b4de307e96e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_finetuned_summ_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_finetuned_summ_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_finetuned_summ_german +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_finetuned_summ_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_german_en_5.4.2_3.0_1724298643201.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_german_en_5.4.2_3.0_1724298643201.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_finetuned_summ_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_finetuned_summ_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_finetuned_summ_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_finetuned_summ_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_finetuned_summ_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_finetuned_summ_german_pipeline_en.md new file mode 100644 index 00000000000000..bf31db42a826d4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_finetuned_summ_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_finetuned_summ_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_finetuned_summ_german_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_finetuned_summ_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_german_pipeline_en_5.4.2_3.0_1724298702848.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_finetuned_summ_german_pipeline_en_5.4.2_3.0_1724298702848.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_finetuned_summ_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_finetuned_summ_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_finetuned_summ_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.2 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_finetuned_summ_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_czech_french_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_czech_french_en.md new file mode 100644 index 00000000000000..ad66460eee0be3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_czech_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_french T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_french +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_french` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_french_en_5.4.2_3.0_1724295312879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_french_en_5.4.2_3.0_1724295312879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_czech_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.1 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_czech_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_czech_french_pipeline_en.md new file mode 100644 index 00000000000000..920655a9b5c896 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_czech_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_czech_french_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_czech_french_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_czech_french_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_french_pipeline_en_5.4.2_3.0_1724295373548.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_czech_french_pipeline_en_5.4.2_3.0_1724295373548.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_czech_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_czech_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_czech_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.1 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_cs_fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_french_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_french_small_finetuned_en.md new file mode 100644 index 00000000000000..80d43e6c624424 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_french_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_french_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_french_small_finetuned +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_french_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_french_small_finetuned_en_5.4.2_3.0_1724351651993.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_french_small_finetuned_en_5.4.2_3.0_1724351651993.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_french_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_french_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_french_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_fr_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_french_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_french_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..b092ba21ca3e3b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_french_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_french_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_french_small_finetuned_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_french_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_french_small_finetuned_pipeline_en_5.4.2_3.0_1724351712003.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_french_small_finetuned_pipeline_en_5.4.2_3.0_1724351712003.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_spanish_french_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_spanish_french_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_french_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_fr_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_german_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_german_en.md new file mode 100644 index 00000000000000..24debd8fcf2fcd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_german T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_german +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_german` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_german_en_5.4.2_3.0_1724323096954.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_german_en_5.4.2_3.0_1724323096954.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_spanish_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_german_pipeline_en.md new file mode 100644 index 00000000000000..0f54f6e9930416 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_spanish_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_spanish_german_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_spanish_german_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_spanish_german_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_german_pipeline_en_5.4.2_3.0_1724323156848.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_spanish_german_pipeline_en_5.4.2_3.0_1724323156848.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_spanish_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_spanish_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_spanish_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|180.3 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_es_de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_swedish_italian_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_swedish_italian_small_finetuned_en.md new file mode 100644 index 00000000000000..f1489b1a3001a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_swedish_italian_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_italian_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_italian_small_finetuned +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_italian_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_italian_small_finetuned_en_5.4.2_3.0_1724292934523.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_italian_small_finetuned_en_5.4.2_3.0_1724292934523.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_italian_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_swedish_italian_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_italian_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_it_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_swedish_italian_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_swedish_italian_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..ffdb8340e864af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-legal_t5_small_trans_swedish_italian_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_swedish_italian_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_swedish_italian_small_finetuned_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_swedish_italian_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_italian_small_finetuned_pipeline_en_5.4.2_3.0_1724292995066.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_swedish_italian_small_finetuned_pipeline_en_5.4.2_3.0_1724292995066.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_swedish_italian_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_swedish_italian_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_swedish_italian_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.4 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_sv_it_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-lil_sum_sum_en.md b/docs/_posts/ahmedlone127/2024-08-22-lil_sum_sum_en.md new file mode 100644 index 00000000000000..9e358bc7284968 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-lil_sum_sum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lil_sum_sum T5Transformer from SamuelMiller +author: John Snow Labs +name: lil_sum_sum +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lil_sum_sum` is a English model originally trained by SamuelMiller. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lil_sum_sum_en_5.4.2_3.0_1724353661259.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lil_sum_sum_en_5.4.2_3.0_1724353661259.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lil_sum_sum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lil_sum_sum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lil_sum_sum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/SamuelMiller/lil_sum_sum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-lil_sum_sum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-lil_sum_sum_pipeline_en.md new file mode 100644 index 00000000000000..3598c12cfe1293 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-lil_sum_sum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lil_sum_sum_pipeline pipeline T5Transformer from SamuelMiller +author: John Snow Labs +name: lil_sum_sum_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lil_sum_sum_pipeline` is a English model originally trained by SamuelMiller. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lil_sum_sum_pipeline_en_5.4.2_3.0_1724353684514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lil_sum_sum_pipeline_en_5.4.2_3.0_1724353684514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lil_sum_sum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lil_sum_sum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lil_sum_sum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/SamuelMiller/lil_sum_sum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-lit5_large_en.md b/docs/_posts/ahmedlone127/2024-08-22-lit5_large_en.md new file mode 100644 index 00000000000000..f9cd7f876fd388 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-lit5_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lit5_large T5Transformer from alemiaschi +author: John Snow Labs +name: lit5_large +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lit5_large` is a English model originally trained by alemiaschi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lit5_large_en_5.4.2_3.0_1724285588726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lit5_large_en_5.4.2_3.0_1724285588726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lit5_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lit5_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lit5_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/alemiaschi/lit5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-lit5_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-lit5_large_pipeline_en.md new file mode 100644 index 00000000000000..c283ce0be15771 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-lit5_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lit5_large_pipeline pipeline T5Transformer from alemiaschi +author: John Snow Labs +name: lit5_large_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lit5_large_pipeline` is a English model originally trained by alemiaschi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lit5_large_pipeline_en_5.4.2_3.0_1724285722838.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lit5_large_pipeline_en_5.4.2_3.0_1724285722838.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lit5_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lit5_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lit5_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/alemiaschi/lit5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-long_ke_t5_small_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-long_ke_t5_small_2_en.md new file mode 100644 index 00000000000000..0a507f30faed1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-long_ke_t5_small_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_ke_t5_small_2 T5Transformer from kimsan0622 +author: John Snow Labs +name: long_ke_t5_small_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_ke_t5_small_2` is a English model originally trained by kimsan0622. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_ke_t5_small_2_en_5.4.2_3.0_1724293882001.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_ke_t5_small_2_en_5.4.2_3.0_1724293882001.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_ke_t5_small_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_ke_t5_small_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_ke_t5_small_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|534.2 MB| + +## References + +https://huggingface.co/kimsan0622/long-ke-t5-small-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-long_ke_t5_small_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-long_ke_t5_small_2_pipeline_en.md new file mode 100644 index 00000000000000..d25ad9dd9baaac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-long_ke_t5_small_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_ke_t5_small_2_pipeline pipeline T5Transformer from kimsan0622 +author: John Snow Labs +name: long_ke_t5_small_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_ke_t5_small_2_pipeline` is a English model originally trained by kimsan0622. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_ke_t5_small_2_pipeline_en_5.4.2_3.0_1724293907968.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_ke_t5_small_2_pipeline_en_5.4.2_3.0_1724293907968.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_ke_t5_small_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_ke_t5_small_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_ke_t5_small_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|534.2 MB| + +## References + +https://huggingface.co/kimsan0622/long-ke-t5-small-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-long_text_balanced_smaller_original_text_en.md b/docs/_posts/ahmedlone127/2024-08-22-long_text_balanced_smaller_original_text_en.md new file mode 100644 index 00000000000000..6b1a5e8d5af918 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-long_text_balanced_smaller_original_text_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_text_balanced_smaller_original_text T5Transformer from weny22 +author: John Snow Labs +name: long_text_balanced_smaller_original_text +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_text_balanced_smaller_original_text` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_text_balanced_smaller_original_text_en_5.4.2_3.0_1724347395260.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_text_balanced_smaller_original_text_en_5.4.2_3.0_1724347395260.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_text_balanced_smaller_original_text","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_text_balanced_smaller_original_text", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_text_balanced_smaller_original_text| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|408.9 MB| + +## References + +https://huggingface.co/weny22/long_text_balanced_smaller_original_text \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-long_text_balanced_smaller_original_text_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-long_text_balanced_smaller_original_text_pipeline_en.md new file mode 100644 index 00000000000000..faf85a9192c8af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-long_text_balanced_smaller_original_text_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English long_text_balanced_smaller_original_text_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: long_text_balanced_smaller_original_text_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_text_balanced_smaller_original_text_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_text_balanced_smaller_original_text_pipeline_en_5.4.2_3.0_1724347415323.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_text_balanced_smaller_original_text_pipeline_en_5.4.2_3.0_1724347415323.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("long_text_balanced_smaller_original_text_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("long_text_balanced_smaller_original_text_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_text_balanced_smaller_original_text_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|408.9 MB| + +## References + +https://huggingface.co/weny22/long_text_balanced_smaller_original_text + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-low6_en.md b/docs/_posts/ahmedlone127/2024-08-22-low6_en.md new file mode 100644 index 00000000000000..d69de372b629ff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-low6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English low6 T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low6 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low6` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low6_en_5.4.2_3.0_1724335988088.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low6_en_5.4.2_3.0_1724335988088.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("low6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("low6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|971.3 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-low6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-low6_pipeline_en.md new file mode 100644 index 00000000000000..7236322078cf6b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-low6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English low6_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low6_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low6_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low6_pipeline_en_5.4.2_3.0_1724336048571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low6_pipeline_en_5.4.2_3.0_1724336048571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("low6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("low6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|971.3 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-lskjf_en.md b/docs/_posts/ahmedlone127/2024-08-22-lskjf_en.md new file mode 100644 index 00000000000000..164edf19057fd5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-lskjf_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lskjf T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: lskjf +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lskjf` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lskjf_en_5.4.2_3.0_1724359976315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lskjf_en_5.4.2_3.0_1724359976315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lskjf","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lskjf", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lskjf| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|984.5 MB| + +## References + +https://huggingface.co/AliGhiasvand86/lskjf \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-lskjf_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-lskjf_pipeline_en.md new file mode 100644 index 00000000000000..e9588447a45eff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-lskjf_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lskjf_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: lskjf_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lskjf_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lskjf_pipeline_en_5.4.2_3.0_1724360031805.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lskjf_pipeline_en_5.4.2_3.0_1724360031805.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lskjf_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lskjf_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lskjf_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|984.5 MB| + +## References + +https://huggingface.co/AliGhiasvand86/lskjf + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-marvin_optimized_base_en.md b/docs/_posts/ahmedlone127/2024-08-22-marvin_optimized_base_en.md new file mode 100644 index 00000000000000..07fbf31ddb4cda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-marvin_optimized_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English marvin_optimized_base T5Transformer from gexai +author: John Snow Labs +name: marvin_optimized_base +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`marvin_optimized_base` is a English model originally trained by gexai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/marvin_optimized_base_en_5.4.2_3.0_1724365936528.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/marvin_optimized_base_en_5.4.2_3.0_1724365936528.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("marvin_optimized_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("marvin_optimized_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|marvin_optimized_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/gexai/marvin-optimized-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-marvin_optimized_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-marvin_optimized_base_pipeline_en.md new file mode 100644 index 00000000000000..f0a25531d3f9a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-marvin_optimized_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English marvin_optimized_base_pipeline pipeline T5Transformer from gexai +author: John Snow Labs +name: marvin_optimized_base_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`marvin_optimized_base_pipeline` is a English model originally trained by gexai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/marvin_optimized_base_pipeline_en_5.4.2_3.0_1724365988271.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/marvin_optimized_base_pipeline_en_5.4.2_3.0_1724365988271.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("marvin_optimized_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("marvin_optimized_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|marvin_optimized_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/gexai/marvin-optimized-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-maven_ere_trigger_seq2seq_en.md b/docs/_posts/ahmedlone127/2024-08-22-maven_ere_trigger_seq2seq_en.md new file mode 100644 index 00000000000000..ed27da77f819ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-maven_ere_trigger_seq2seq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English maven_ere_trigger_seq2seq T5Transformer from ahmeshaf +author: John Snow Labs +name: maven_ere_trigger_seq2seq +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`maven_ere_trigger_seq2seq` is a English model originally trained by ahmeshaf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/maven_ere_trigger_seq2seq_en_5.4.2_3.0_1724289790327.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/maven_ere_trigger_seq2seq_en_5.4.2_3.0_1724289790327.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("maven_ere_trigger_seq2seq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("maven_ere_trigger_seq2seq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|maven_ere_trigger_seq2seq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/ahmeshaf/maven_ere_trigger_seq2seq \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-maven_ere_trigger_seq2seq_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-maven_ere_trigger_seq2seq_pipeline_en.md new file mode 100644 index 00000000000000..39944f525aa2d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-maven_ere_trigger_seq2seq_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English maven_ere_trigger_seq2seq_pipeline pipeline T5Transformer from ahmeshaf +author: John Snow Labs +name: maven_ere_trigger_seq2seq_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`maven_ere_trigger_seq2seq_pipeline` is a English model originally trained by ahmeshaf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/maven_ere_trigger_seq2seq_pipeline_en_5.4.2_3.0_1724289921903.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/maven_ere_trigger_seq2seq_pipeline_en_5.4.2_3.0_1724289921903.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("maven_ere_trigger_seq2seq_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("maven_ere_trigger_seq2seq_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|maven_ere_trigger_seq2seq_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/ahmeshaf/maven_ere_trigger_seq2seq + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mnli_t5_base_seed_3_en.md b/docs/_posts/ahmedlone127/2024-08-22-mnli_t5_base_seed_3_en.md new file mode 100644 index 00000000000000..78fea748c25133 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mnli_t5_base_seed_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mnli_t5_base_seed_3 T5Transformer from utahnlp +author: John Snow Labs +name: mnli_t5_base_seed_3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mnli_t5_base_seed_3` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mnli_t5_base_seed_3_en_5.4.2_3.0_1724352425318.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mnli_t5_base_seed_3_en_5.4.2_3.0_1724352425318.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mnli_t5_base_seed_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mnli_t5_base_seed_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mnli_t5_base_seed_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|987.0 MB| + +## References + +https://huggingface.co/utahnlp/mnli_t5-base_seed-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mnli_t5_base_seed_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mnli_t5_base_seed_3_pipeline_en.md new file mode 100644 index 00000000000000..53770b7f44f9aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mnli_t5_base_seed_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mnli_t5_base_seed_3_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: mnli_t5_base_seed_3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mnli_t5_base_seed_3_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mnli_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724352479934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mnli_t5_base_seed_3_pipeline_en_5.4.2_3.0_1724352479934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mnli_t5_base_seed_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mnli_t5_base_seed_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mnli_t5_base_seed_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|987.0 MB| + +## References + +https://huggingface.co/utahnlp/mnli_t5-base_seed-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-model_t5_vrushali_en.md b/docs/_posts/ahmedlone127/2024-08-22-model_t5_vrushali_en.md new file mode 100644 index 00000000000000..5a7df0f0ad34f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-model_t5_vrushali_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English model_t5_vrushali T5Transformer from Vrushali +author: John Snow Labs +name: model_t5_vrushali +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`model_t5_vrushali` is a English model originally trained by Vrushali. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/model_t5_vrushali_en_5.4.2_3.0_1724294549032.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/model_t5_vrushali_en_5.4.2_3.0_1724294549032.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("model_t5_vrushali","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("model_t5_vrushali", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|model_t5_vrushali| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Vrushali/model-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-model_t5_vrushali_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-model_t5_vrushali_pipeline_en.md new file mode 100644 index 00000000000000..7a0e314950240a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-model_t5_vrushali_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English model_t5_vrushali_pipeline pipeline T5Transformer from Vrushali +author: John Snow Labs +name: model_t5_vrushali_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`model_t5_vrushali_pipeline` is a English model originally trained by Vrushali. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/model_t5_vrushali_pipeline_en_5.4.2_3.0_1724294601963.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/model_t5_vrushali_pipeline_en_5.4.2_3.0_1724294601963.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("model_t5_vrushali_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("model_t5_vrushali_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|model_t5_vrushali_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Vrushali/model-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-molt5_base_extra_feature_fine_tune_en.md b/docs/_posts/ahmedlone127/2024-08-22-molt5_base_extra_feature_fine_tune_en.md new file mode 100644 index 00000000000000..ec612ad0848e88 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-molt5_base_extra_feature_fine_tune_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English molt5_base_extra_feature_fine_tune T5Transformer from Phudish +author: John Snow Labs +name: molt5_base_extra_feature_fine_tune +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_base_extra_feature_fine_tune` is a English model originally trained by Phudish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_base_extra_feature_fine_tune_en_5.4.2_3.0_1724294942649.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_base_extra_feature_fine_tune_en_5.4.2_3.0_1724294942649.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("molt5_base_extra_feature_fine_tune","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("molt5_base_extra_feature_fine_tune", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_base_extra_feature_fine_tune| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Phudish/molt5-base-extra-feature-fine-tune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-molt5_base_extra_feature_fine_tune_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-molt5_base_extra_feature_fine_tune_pipeline_en.md new file mode 100644 index 00000000000000..be74d930256950 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-molt5_base_extra_feature_fine_tune_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English molt5_base_extra_feature_fine_tune_pipeline pipeline T5Transformer from Phudish +author: John Snow Labs +name: molt5_base_extra_feature_fine_tune_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`molt5_base_extra_feature_fine_tune_pipeline` is a English model originally trained by Phudish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/molt5_base_extra_feature_fine_tune_pipeline_en_5.4.2_3.0_1724294991626.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/molt5_base_extra_feature_fine_tune_pipeline_en_5.4.2_3.0_1724294991626.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("molt5_base_extra_feature_fine_tune_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("molt5_base_extra_feature_fine_tune_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|molt5_base_extra_feature_fine_tune_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Phudish/molt5-base-extra-feature-fine-tune + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_0_15solid_cctk_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_0_15solid_cctk_en.md new file mode 100644 index 00000000000000..ad221fe8fe4859 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_0_15solid_cctk_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_0_15solid_cctk T5Transformer from tharindu +author: John Snow Labs +name: mt5_0_15solid_cctk +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_0_15solid_cctk` is a English model originally trained by tharindu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_0_15solid_cctk_en_5.4.2_3.0_1724321232797.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_0_15solid_cctk_en_5.4.2_3.0_1724321232797.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_0_15solid_cctk","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_0_15solid_cctk", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_0_15solid_cctk| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/tharindu/mt5_0.15SOLID_CCTK \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_0_15solid_cctk_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_0_15solid_cctk_pipeline_en.md new file mode 100644 index 00000000000000..44d2ca57054cfe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_0_15solid_cctk_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_0_15solid_cctk_pipeline pipeline T5Transformer from tharindu +author: John Snow Labs +name: mt5_0_15solid_cctk_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_0_15solid_cctk_pipeline` is a English model originally trained by tharindu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_0_15solid_cctk_pipeline_en_5.4.2_3.0_1724321457510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_0_15solid_cctk_pipeline_en_5.4.2_3.0_1724321457510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_0_15solid_cctk_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_0_15solid_cctk_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_0_15solid_cctk_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/tharindu/mt5_0.15SOLID_CCTK + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_2_3_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_2_3_en.md new file mode 100644 index 00000000000000..f6a58ea08e5bc9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_2_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_2_3 T5Transformer from obokkkk +author: John Snow Labs +name: mt5_base_2_3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_2_3` is a English model originally trained by obokkkk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_2_3_en_5.4.2_3.0_1724287787259.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_2_3_en_5.4.2_3.0_1724287787259.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_2_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_2_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_2_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/obokkkk/mt5-base_2_3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_2_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_2_3_pipeline_en.md new file mode 100644 index 00000000000000..c6720b9b4add39 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_2_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_2_3_pipeline pipeline T5Transformer from obokkkk +author: John Snow Labs +name: mt5_base_2_3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_2_3_pipeline` is a English model originally trained by obokkkk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_2_3_pipeline_en_5.4.2_3.0_1724287935927.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_2_3_pipeline_en_5.4.2_3.0_1724287935927.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_2_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_2_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_2_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/obokkkk/mt5-base_2_3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_binary_czech_iiia_cs.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_binary_czech_iiia_cs.md new file mode 100644 index 00000000000000..18797415865d7d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_binary_czech_iiia_cs.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Czech mt5_base_binary_czech_iiia T5Transformer from chi2024 +author: John Snow Labs +name: mt5_base_binary_czech_iiia +date: 2024-08-22 +tags: [cs, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: cs +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_binary_czech_iiia` is a Czech model originally trained by chi2024. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_binary_czech_iiia_cs_5.4.2_3.0_1724297554761.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_binary_czech_iiia_cs_5.4.2_3.0_1724297554761.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_binary_czech_iiia","cs") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_binary_czech_iiia", "cs") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_binary_czech_iiia| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|cs| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chi2024/mt5-base-binary-cs-iiia \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_binary_czech_iiia_pipeline_cs.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_binary_czech_iiia_pipeline_cs.md new file mode 100644 index 00000000000000..d69747316c832c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_binary_czech_iiia_pipeline_cs.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Czech mt5_base_binary_czech_iiia_pipeline pipeline T5Transformer from chi2024 +author: John Snow Labs +name: mt5_base_binary_czech_iiia_pipeline +date: 2024-08-22 +tags: [cs, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: cs +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_binary_czech_iiia_pipeline` is a Czech model originally trained by chi2024. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_binary_czech_iiia_pipeline_cs_5.4.2_3.0_1724297854589.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_binary_czech_iiia_pipeline_cs_5.4.2_3.0_1724297854589.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_binary_czech_iiia_pipeline", lang = "cs") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_binary_czech_iiia_pipeline", lang = "cs") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_binary_czech_iiia_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|cs| +|Size:|2.3 GB| + +## References + +https://huggingface.co/chi2024/mt5-base-binary-cs-iiia + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_esquad_qg_trimmed_45000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_esquad_qg_trimmed_45000_en.md new file mode 100644 index 00000000000000..00304c6b1ef82b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_esquad_qg_trimmed_45000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_esquad_qg_trimmed_45000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_esquad_qg_trimmed_45000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qg_trimmed_45000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_45000_en_5.4.2_3.0_1724364057803.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_45000_en_5.4.2_3.0_1724364057803.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_esquad_qg_trimmed_45000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_esquad_qg_trimmed_45000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qg_trimmed_45000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-esquad-qg-trimmed-45000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_esquad_qg_trimmed_45000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_esquad_qg_trimmed_45000_pipeline_en.md new file mode 100644 index 00000000000000..9d18c9e5a4a74f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_esquad_qg_trimmed_45000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_esquad_qg_trimmed_45000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_esquad_qg_trimmed_45000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_esquad_qg_trimmed_45000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_45000_pipeline_en_5.4.2_3.0_1724364111863.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_esquad_qg_trimmed_45000_pipeline_en_5.4.2_3.0_1724364111863.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_esquad_qg_trimmed_45000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_esquad_qg_trimmed_45000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_esquad_qg_trimmed_45000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-esquad-qg-trimmed-45000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_bengali_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_bengali_summarization_en.md new file mode 100644 index 00000000000000..e200e1f63f0dfe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_bengali_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_bengali_summarization T5Transformer from baibars +author: John Snow Labs +name: mt5_base_finetuned_bengali_summarization +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_bengali_summarization` is a English model originally trained by baibars. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_bengali_summarization_en_5.4.2_3.0_1724307155855.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_bengali_summarization_en_5.4.2_3.0_1724307155855.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_bengali_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_bengali_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_bengali_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/baibars/mt5-base-finetuned-bn-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government_en.md new file mode 100644 index 00000000000000..7cac12d46ffe40 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government T5Transformer from himanshubeniwal +author: John Snow Labs +name: mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government` is a English model originally trained by himanshubeniwal. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government_en_5.4.2_3.0_1724350502825.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government_en_5.4.2_3.0_1724350502825.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_kazakh_tonga_tonga_islands_english_fraud_government| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/himanshubeniwal/mt5-base-finetuned-kk-to-en-fraud-government \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base_en.md new file mode 100644 index 00000000000000..6ef099ad3e0ce9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base T5Transformer from nestoralvaro +author: John Snow Labs +name: mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base` is a English model originally trained by nestoralvaro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base_en_5.4.2_3.0_1724313411661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base_en_5.4.2_3.0_1724313411661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_finetuned_xsum_data_prep_2021_12_26___t8_54_csv___topic_text_google_mt5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/nestoralvaro/mt5-base-finetuned-xsum-data_prep_2021_12_26___t8_54.csv___topic_text_google_mt5_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_frquad_qg_trimmed_30000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_frquad_qg_trimmed_30000_en.md new file mode 100644 index 00000000000000..02413d249cc69f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_frquad_qg_trimmed_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_frquad_qg_trimmed_30000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_frquad_qg_trimmed_30000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qg_trimmed_30000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_30000_en_5.4.2_3.0_1724368519052.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_30000_en_5.4.2_3.0_1724368519052.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_frquad_qg_trimmed_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_frquad_qg_trimmed_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qg_trimmed_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|977.3 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-frquad-qg-trimmed-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_frquad_qg_trimmed_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_frquad_qg_trimmed_30000_pipeline_en.md new file mode 100644 index 00000000000000..e9fd8c0f30f2d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_frquad_qg_trimmed_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_frquad_qg_trimmed_30000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_frquad_qg_trimmed_30000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_frquad_qg_trimmed_30000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_30000_pipeline_en_5.4.2_3.0_1724368568950.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_frquad_qg_trimmed_30000_pipeline_en_5.4.2_3.0_1724368568950.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_frquad_qg_trimmed_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_frquad_qg_trimmed_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_frquad_qg_trimmed_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|977.3 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-frquad-qg-trimmed-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ft_msmarco_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ft_msmarco_en.md new file mode 100644 index 00000000000000..f025dd64b5f0f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ft_msmarco_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_ft_msmarco T5Transformer from castorini +author: John Snow Labs +name: mt5_base_ft_msmarco +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ft_msmarco` is a English model originally trained by castorini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ft_msmarco_en_5.4.2_3.0_1724305373319.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ft_msmarco_en_5.4.2_3.0_1724305373319.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_ft_msmarco","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_ft_msmarco", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ft_msmarco| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/castorini/mt5-base-ft-msmarco \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ft_msmarco_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ft_msmarco_pipeline_en.md new file mode 100644 index 00000000000000..92d937d5ac8b29 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ft_msmarco_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_ft_msmarco_pipeline pipeline T5Transformer from castorini +author: John Snow Labs +name: mt5_base_ft_msmarco_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ft_msmarco_pipeline` is a English model originally trained by castorini. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ft_msmarco_pipeline_en_5.4.2_3.0_1724305598877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ft_msmarco_pipeline_en_5.4.2_3.0_1724305598877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_ft_msmarco_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_ft_msmarco_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ft_msmarco_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.5 GB| + +## References + +https://huggingface.co/castorini/mt5-base-ft-msmarco + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_e3_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_e3_en.md new file mode 100644 index 00000000000000..c5c01d2b66573f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_e3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_gecid23_e3 T5Transformer from jeremyvictor +author: John Snow Labs +name: mt5_base_gecid23_e3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_gecid23_e3` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_gecid23_e3_en_5.4.2_3.0_1724350593823.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_gecid23_e3_en_5.4.2_3.0_1724350593823.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_gecid23_e3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_gecid23_e3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_gecid23_e3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/jeremyvictor/mt5-base-gecid23-e3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_e3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_e3_pipeline_en.md new file mode 100644 index 00000000000000..af1a404f995bf6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_e3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_gecid23_e3_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: mt5_base_gecid23_e3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_gecid23_e3_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_gecid23_e3_pipeline_en_5.4.2_3.0_1724350899798.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_gecid23_e3_pipeline_en_5.4.2_3.0_1724350899798.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_gecid23_e3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_gecid23_e3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_gecid23_e3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/jeremyvictor/mt5-base-gecid23-e3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_en.md new file mode 100644 index 00000000000000..589c2aa33c0298 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_gecid23_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_gecid23 T5Transformer from jeremyvictor +author: John Snow Labs +name: mt5_base_gecid23 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_gecid23` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_gecid23_en_5.4.2_3.0_1724355341542.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_gecid23_en_5.4.2_3.0_1724355341542.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_gecid23","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_gecid23", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_gecid23| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/jeremyvictor/mt5-base-gecid23 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_itquad_ae_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_itquad_ae_pipeline_it.md new file mode 100644 index 00000000000000..dfc260b6280408 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_itquad_ae_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_base_itquad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_itquad_ae_pipeline +date: 2024-08-22 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_itquad_ae_pipeline` is a Italian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_ae_pipeline_it_5.4.2_3.0_1724310906873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_itquad_ae_pipeline_it_5.4.2_3.0_1724310906873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_itquad_ae_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_itquad_ae_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_itquad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|2.4 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-itquad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline_xx.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline_xx.md new file mode 100644 index 00000000000000..28e18ea73144aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline_xx.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Multilingual mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline pipeline T5Transformer from ctu-aic +author: John Snow Labs +name: mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline +date: 2024-08-22 +tags: [xx, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline` is a Multilingual model originally trained by ctu-aic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline_xx_5.4.2_3.0_1724351218283.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline_xx_5.4.2_3.0_1724351218283.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline", lang = "xx") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline", lang = "xx") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_multilingual_summarization_multilarge_czech_smesum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|xx| +|Size:|6.0 MB| + +## References + +https://huggingface.co/ctu-aic/mt5-base-multilingual-summarization-multilarge-cs-smesum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_multilingual_summarization_multilarge_czech_smesum_xx.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_multilingual_summarization_multilarge_czech_smesum_xx.md new file mode 100644 index 00000000000000..7058065314e899 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_multilingual_summarization_multilarge_czech_smesum_xx.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Multilingual mt5_base_multilingual_summarization_multilarge_czech_smesum T5Transformer from ctu-aic +author: John Snow Labs +name: mt5_base_multilingual_summarization_multilarge_czech_smesum +date: 2024-08-22 +tags: [xx, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: xx +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_multilingual_summarization_multilarge_czech_smesum` is a Multilingual model originally trained by ctu-aic. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_multilingual_summarization_multilarge_czech_smesum_xx_5.4.2_3.0_1724351208481.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_multilingual_summarization_multilarge_czech_smesum_xx_5.4.2_3.0_1724351208481.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_multilingual_summarization_multilarge_czech_smesum","xx") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_multilingual_summarization_multilarge_czech_smesum", "xx") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_multilingual_summarization_multilarge_czech_smesum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|xx| +|Size:|6.0 MB| + +## References + +https://huggingface.co/ctu-aic/mt5-base-multilingual-summarization-multilarge-cs-smesum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_10k_ptes_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_10k_ptes_en.md new file mode 100644 index 00000000000000..c6296514c2a9a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_10k_ptes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_10k_ptes T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_10k_ptes +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_10k_ptes` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_10k_ptes_en_5.4.2_3.0_1724350140285.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_10k_ptes_en_5.4.2_3.0_1724350140285.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_10k_ptes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_10k_ptes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_10k_ptes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-10k-ptes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_10k_ptes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_10k_ptes_pipeline_en.md new file mode 100644 index 00000000000000..1bc3596f910fcc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_10k_ptes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_10k_ptes_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_10k_ptes_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_10k_ptes_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_10k_ptes_pipeline_en_5.4.2_3.0_1724350452817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_10k_ptes_pipeline_en_5.4.2_3.0_1724350452817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_10k_ptes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_10k_ptes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_10k_ptes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-10k-ptes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_250k_ruen_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_250k_ruen_en.md new file mode 100644 index 00000000000000..e497009d5ebc8b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_250k_ruen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_250k_ruen T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_250k_ruen +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_250k_ruen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_ruen_en_5.4.2_3.0_1724342037321.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_ruen_en_5.4.2_3.0_1724342037321.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_250k_ruen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_250k_ruen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_250k_ruen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-250k-ruen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_250k_ruen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_250k_ruen_pipeline_en.md new file mode 100644 index 00000000000000..7a3359471058a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_250k_ruen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_250k_ruen_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_250k_ruen_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_250k_ruen_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_ruen_pipeline_en_5.4.2_3.0_1724342309147.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_250k_ruen_pipeline_en_5.4.2_3.0_1724342309147.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_250k_ruen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_250k_ruen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_250k_ruen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-250k-ruen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_2k_ptes_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_2k_ptes_en.md new file mode 100644 index 00000000000000..f282937b0ab18e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_2k_ptes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_2k_ptes T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_2k_ptes +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_2k_ptes` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_ptes_en_5.4.2_3.0_1724304004888.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_ptes_en_5.4.2_3.0_1724304004888.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_2k_ptes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_2k_ptes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_2k_ptes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-2k-ptes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_2k_ptes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_2k_ptes_pipeline_en.md new file mode 100644 index 00000000000000..c7bc800eb3d018 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_2k_ptes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_2k_ptes_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_2k_ptes_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_2k_ptes_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_ptes_pipeline_en_5.4.2_3.0_1724304312636.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_2k_ptes_pipeline_en_5.4.2_3.0_1724304312636.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_2k_ptes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_2k_ptes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_2k_ptes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-2k-ptes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_400_ruen_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_400_ruen_en.md new file mode 100644 index 00000000000000..f3e7eca64867ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_400_ruen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_400_ruen T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_400_ruen +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_400_ruen` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_400_ruen_en_5.4.2_3.0_1724312505814.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_400_ruen_en_5.4.2_3.0_1724312505814.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_400_ruen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_400_ruen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_400_ruen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-400-ruen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_400_ruen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_400_ruen_pipeline_en.md new file mode 100644 index 00000000000000..c4dd4c071f26b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_nc16_400_ruen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_400_ruen_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_400_ruen_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_400_ruen_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_400_ruen_pipeline_en_5.4.2_3.0_1724312817594.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_400_ruen_pipeline_en_5.4.2_3.0_1724312817594.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_400_ruen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_400_ruen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_400_ruen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-400-ruen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_qg_ap_nopeft_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_qg_ap_nopeft_en.md new file mode 100644 index 00000000000000..b0b11b90ce47ce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_qg_ap_nopeft_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_qg_ap_nopeft T5Transformer from tiagoblima +author: John Snow Labs +name: mt5_base_qg_ap_nopeft +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_qg_ap_nopeft` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_qg_ap_nopeft_en_5.4.2_3.0_1724362684024.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_qg_ap_nopeft_en_5.4.2_3.0_1724362684024.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_qg_ap_nopeft","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_qg_ap_nopeft", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_qg_ap_nopeft| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/tiagoblima/mt5_base-qg-ap-nopeft \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_qg_ap_nopeft_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_qg_ap_nopeft_pipeline_en.md new file mode 100644 index 00000000000000..8baead9e3ebbe1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_qg_ap_nopeft_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_qg_ap_nopeft_pipeline pipeline T5Transformer from tiagoblima +author: John Snow Labs +name: mt5_base_qg_ap_nopeft_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_qg_ap_nopeft_pipeline` is a English model originally trained by tiagoblima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_qg_ap_nopeft_pipeline_en_5.4.2_3.0_1724362957449.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_qg_ap_nopeft_pipeline_en_5.4.2_3.0_1724362957449.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_qg_ap_nopeft_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_qg_ap_nopeft_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_qg_ap_nopeft_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/tiagoblima/mt5_base-qg-ap-nopeft + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_ae_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_ae_pipeline_ru.md new file mode 100644 index 00000000000000..c0c46b95d7f830 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_ae_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_base_ruquad_ae_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_ruquad_ae_pipeline +date: 2024-08-22 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ruquad_ae_pipeline` is a Russian model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_ae_pipeline_ru_5.4.2_3.0_1724332575344.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_ae_pipeline_ru_5.4.2_3.0_1724332575344.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_ruquad_ae_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_ruquad_ae_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ruquad_ae_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|2.3 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-ruquad-ae + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_qg_trimmed_75000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_qg_trimmed_75000_en.md new file mode 100644 index 00000000000000..47ef414d66c072 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_qg_trimmed_75000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_ruquad_qg_trimmed_75000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_ruquad_qg_trimmed_75000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ruquad_qg_trimmed_75000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_trimmed_75000_en_5.4.2_3.0_1724309530907.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_trimmed_75000_en_5.4.2_3.0_1724309530907.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_ruquad_qg_trimmed_75000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_ruquad_qg_trimmed_75000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ruquad_qg_trimmed_75000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-ruquad-qg-trimmed-75000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_qg_trimmed_75000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_qg_trimmed_75000_pipeline_en.md new file mode 100644 index 00000000000000..d3cc84df503911 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_ruquad_qg_trimmed_75000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_ruquad_qg_trimmed_75000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_ruquad_qg_trimmed_75000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ruquad_qg_trimmed_75000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_trimmed_75000_pipeline_en_5.4.2_3.0_1724309599557.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_trimmed_75000_pipeline_en_5.4.2_3.0_1724309599557.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_ruquad_qg_trimmed_75000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_ruquad_qg_trimmed_75000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ruquad_qg_trimmed_75000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/research-backup/mt5-base-ruquad-qg-trimmed-75000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_french_105000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_french_105000_en.md new file mode 100644 index 00000000000000..1932ee4393a0e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_french_105000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_french_105000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_105000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_105000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_105000_en_5.4.2_3.0_1724343561585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_105000_en_5.4.2_3.0_1724343561585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_french_105000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_french_105000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_105000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|843.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr-105000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_french_105000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_french_105000_pipeline_en.md new file mode 100644 index 00000000000000..82010af5f3006b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_french_105000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_french_105000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_french_105000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_french_105000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_105000_pipeline_en_5.4.2_3.0_1724343847592.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_french_105000_pipeline_en_5.4.2_3.0_1724343847592.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_french_105000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_french_105000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_french_105000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|843.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-fr-105000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_15000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_15000_en.md new file mode 100644 index 00000000000000..e1dcef1f8a6d42 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_italian_15000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_italian_15000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_italian_15000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_15000_en_5.4.2_3.0_1724309705345.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_15000_en_5.4.2_3.0_1724309705345.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_italian_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_italian_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_italian_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|447.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-it-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_15000_pipeline_en.md new file mode 100644 index 00000000000000..0633cc9dd18926 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_italian_15000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_italian_15000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_italian_15000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_15000_pipeline_en_5.4.2_3.0_1724309855868.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_15000_pipeline_en_5.4.2_3.0_1724309855868.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_italian_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_italian_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_italian_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|447.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-it-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_45000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_45000_en.md new file mode 100644 index 00000000000000..7a94784cdfac2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_45000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_italian_45000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_italian_45000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_italian_45000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_45000_en_5.4.2_3.0_1724312721002.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_45000_en_5.4.2_3.0_1724312721002.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_italian_45000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_italian_45000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_italian_45000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|579.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-it-45000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_45000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_45000_pipeline_en.md new file mode 100644 index 00000000000000..35b5718e6143d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_italian_45000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_italian_45000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_italian_45000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_italian_45000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_45000_pipeline_en_5.4.2_3.0_1724312914070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_italian_45000_pipeline_en_5.4.2_3.0_1724312914070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_italian_45000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_italian_45000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_italian_45000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|579.6 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-it-45000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_45000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_45000_en.md new file mode 100644 index 00000000000000..5714b4bf5b81bf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_45000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_japanese_45000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_japanese_45000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_japanese_45000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_45000_en_5.4.2_3.0_1724314316496.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_45000_en_5.4.2_3.0_1724314316496.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_japanese_45000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_japanese_45000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_japanese_45000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|579.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ja-45000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_45000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_45000_pipeline_en.md new file mode 100644 index 00000000000000..b79667c353fcab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_45000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_japanese_45000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_japanese_45000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_japanese_45000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_45000_pipeline_en_5.4.2_3.0_1724314513368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_45000_pipeline_en_5.4.2_3.0_1724314513368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_japanese_45000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_japanese_45000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_japanese_45000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|579.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ja-45000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_en.md new file mode 100644 index 00000000000000..2ce9c14f179971 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_japanese T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_japanese +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_japanese` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_en_5.4.2_3.0_1724306508969.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_en_5.4.2_3.0_1724306508969.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_japanese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_japanese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_japanese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|935.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ja \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_pipeline_en.md new file mode 100644 index 00000000000000..7599c48dce907f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_japanese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_japanese_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_japanese_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_japanese_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_pipeline_en_5.4.2_3.0_1724306822977.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_japanese_pipeline_en_5.4.2_3.0_1724306822977.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_japanese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_japanese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_japanese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|935.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-ja + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_spanish_90000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_spanish_90000_en.md new file mode 100644 index 00000000000000..7148b6060205ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_spanish_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_90000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_90000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_90000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_90000_en_5.4.2_3.0_1724347986908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_90000_en_5.4.2_3.0_1724347986908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_spanish_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|777.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_spanish_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_spanish_90000_pipeline_en.md new file mode 100644 index 00000000000000..e27e876abd39fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_base_trimmed_spanish_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_spanish_90000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_spanish_90000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_spanish_90000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_90000_pipeline_en_5.4.2_3.0_1724348242755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_spanish_90000_pipeline_en_5.4.2_3.0_1724348242755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_spanish_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_spanish_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_spanish_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|777.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-es-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_based_hindi_enhi_maltese_model_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_based_hindi_enhi_maltese_model_en.md new file mode 100644 index 00000000000000..bab91309162bf6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_based_hindi_enhi_maltese_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_based_hindi_enhi_maltese_model T5Transformer from kapilrk04 +author: John Snow Labs +name: mt5_based_hindi_enhi_maltese_model +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_based_hindi_enhi_maltese_model` is a English model originally trained by kapilrk04. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_based_hindi_enhi_maltese_model_en_5.4.2_3.0_1724345703226.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_based_hindi_enhi_maltese_model_en_5.4.2_3.0_1724345703226.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_based_hindi_enhi_maltese_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_based_hindi_enhi_maltese_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_based_hindi_enhi_maltese_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/kapilrk04/mt5_based_hi_enhi_mt_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_based_hindi_enhi_maltese_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_based_hindi_enhi_maltese_model_pipeline_en.md new file mode 100644 index 00000000000000..a0fe8173e1d6c4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_based_hindi_enhi_maltese_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_based_hindi_enhi_maltese_model_pipeline pipeline T5Transformer from kapilrk04 +author: John Snow Labs +name: mt5_based_hindi_enhi_maltese_model_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_based_hindi_enhi_maltese_model_pipeline` is a English model originally trained by kapilrk04. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_based_hindi_enhi_maltese_model_pipeline_en_5.4.2_3.0_1724345854756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_based_hindi_enhi_maltese_model_pipeline_en_5.4.2_3.0_1724345854756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_based_hindi_enhi_maltese_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_based_hindi_enhi_maltese_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_based_hindi_enhi_maltese_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/kapilrk04/mt5_based_hi_enhi_mt_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_deed_sum_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_deed_sum_1_en.md new file mode 100644 index 00000000000000..f8e6ceb3d46a25 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_deed_sum_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_deed_sum_1 T5Transformer from Hasanur525 +author: John Snow Labs +name: mt5_deed_sum_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_deed_sum_1` is a English model originally trained by Hasanur525. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_deed_sum_1_en_5.4.2_3.0_1724317679409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_deed_sum_1_en_5.4.2_3.0_1724317679409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_deed_sum_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_deed_sum_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_deed_sum_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/Hasanur525/mt5_deed_sum_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_deed_sum_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_deed_sum_1_pipeline_en.md new file mode 100644 index 00000000000000..80958af5df147a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_deed_sum_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_deed_sum_1_pipeline pipeline T5Transformer from Hasanur525 +author: John Snow Labs +name: mt5_deed_sum_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_deed_sum_1_pipeline` is a English model originally trained by Hasanur525. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_deed_sum_1_pipeline_en_5.4.2_3.0_1724317923684.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_deed_sum_1_pipeline_en_5.4.2_3.0_1724317923684.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_deed_sum_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_deed_sum_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_deed_sum_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/Hasanur525/mt5_deed_sum_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_english_rr_1000_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_english_rr_1000_v2_en.md new file mode 100644 index 00000000000000..83540f30d172df --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_english_rr_1000_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_english_rr_1000_v2 T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_english_rr_1000_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_rr_1000_v2` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_rr_1000_v2_en_5.4.2_3.0_1724359144879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_rr_1000_v2_en_5.4.2_3.0_1724359144879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_english_rr_1000_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_english_rr_1000_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_rr_1000_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-en-rr-1000-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_chinese_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_chinese_en.md new file mode 100644 index 00000000000000..b008f94b5af4c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_chinese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_chinese T5Transformer from sdinger +author: John Snow Labs +name: mt5_finetuned_amazon_english_chinese +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_chinese` is a English model originally trained by sdinger. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_chinese_en_5.4.2_3.0_1724365533025.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_chinese_en_5.4.2_3.0_1724365533025.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_chinese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_chinese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_chinese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sdinger/mt5-finetuned-amazon-en-zh \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_chinese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_chinese_pipeline_en.md new file mode 100644 index 00000000000000..a8de47262d18cf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_chinese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_chinese_pipeline pipeline T5Transformer from sdinger +author: John Snow Labs +name: mt5_finetuned_amazon_english_chinese_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_chinese_pipeline` is a English model originally trained by sdinger. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_chinese_pipeline_en_5.4.2_3.0_1724365631495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_chinese_pipeline_en_5.4.2_3.0_1724365631495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_finetuned_amazon_english_chinese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_finetuned_amazon_english_chinese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_chinese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sdinger/mt5-finetuned-amazon-en-zh + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_terps_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_terps_en.md new file mode 100644 index 00000000000000..8942cf6a43a0ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_terps_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_terps T5Transformer from Terps +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_terps +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_terps` is a English model originally trained by Terps. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_terps_en_5.4.2_3.0_1724355179374.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_terps_en_5.4.2_3.0_1724355179374.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_terps","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_terps", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_terps| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Terps/mt5-finetuned-amazon-en-es-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline_en.md new file mode 100644 index 00000000000000..47a16a7c6e4fcd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline pipeline T5Transformer from Terps +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline` is a English model originally trained by Terps. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline_en_5.4.2_3.0_1724355326364.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline_en_5.4.2_3.0_1724355326364.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_terps_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Terps/mt5-finetuned-amazon-en-es-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_en.md new file mode 100644 index 00000000000000..c337532ec3b841 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas T5Transformer from vsrinivas +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas` is a English model originally trained by vsrinivas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_en_5.4.2_3.0_1724295260296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_en_5.4.2_3.0_1724295260296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/vsrinivas/mt5-finetuned-amazon-en-es-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline_en.md new file mode 100644 index 00000000000000..00e084298365ca --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline pipeline T5Transformer from vsrinivas +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline` is a English model originally trained by vsrinivas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline_en_5.4.2_3.0_1724295411297.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline_en_5.4.2_3.0_1724295411297.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_vsrinivas_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/vsrinivas/mt5-finetuned-amazon-en-es-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_fixth_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_fixth_en.md new file mode 100644 index 00000000000000..6805b49c018bd4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_fixth_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_fixth T5Transformer from napatswift +author: John Snow Labs +name: mt5_fixth +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_fixth` is a English model originally trained by napatswift. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_fixth_en_5.4.2_3.0_1724317441953.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_fixth_en_5.4.2_3.0_1724317441953.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_fixth","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_fixth", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_fixth| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/napatswift/mt5-fixth \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_fixth_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_fixth_pipeline_en.md new file mode 100644 index 00000000000000..a9833d36209562 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_fixth_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_fixth_pipeline pipeline T5Transformer from napatswift +author: John Snow Labs +name: mt5_fixth_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_fixth_pipeline` is a English model originally trained by napatswift. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_fixth_pipeline_en_5.4.2_3.0_1724317534183.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_fixth_pipeline_en_5.4.2_3.0_1724317534183.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_fixth_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_fixth_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_fixth_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/napatswift/mt5-fixth + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_fon_french_news_fr.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_fon_french_news_fr.md new file mode 100644 index 00000000000000..ee3d4044d55193 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_fon_french_news_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_fon_french_news T5Transformer from masakhane +author: John Snow Labs +name: mt5_fon_french_news +date: 2024-08-22 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_fon_french_news` is a French model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_fon_french_news_fr_5.4.2_3.0_1724309033228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_fon_french_news_fr_5.4.2_3.0_1724309033228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_fon_french_news","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_fon_french_news", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_fon_french_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_fon_fr_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_fon_french_news_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_fon_french_news_pipeline_fr.md new file mode 100644 index 00000000000000..b24b6691afbfc1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_fon_french_news_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_fon_french_news_pipeline pipeline T5Transformer from masakhane +author: John Snow Labs +name: mt5_fon_french_news_pipeline +date: 2024-08-22 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_fon_french_news_pipeline` is a French model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_fon_french_news_pipeline_fr_5.4.2_3.0_1724309354352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_fon_french_news_pipeline_fr_5.4.2_3.0_1724309354352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_fon_french_news_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_fon_french_news_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_fon_french_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_fon_fr_news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_large_norwegian_nynorsk_no.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_large_norwegian_nynorsk_no.md new file mode 100644 index 00000000000000..048b26ef069b9d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_large_norwegian_nynorsk_no.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Norwegian mt5_large_norwegian_nynorsk T5Transformer from norkart +author: John Snow Labs +name: mt5_large_norwegian_nynorsk +date: 2024-08-22 +tags: ["no", open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: "no" +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_large_norwegian_nynorsk` is a Norwegian model originally trained by norkart. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_large_norwegian_nynorsk_no_5.4.2_3.0_1724287355199.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_large_norwegian_nynorsk_no_5.4.2_3.0_1724287355199.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_large_norwegian_nynorsk","no") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_large_norwegian_nynorsk", "no") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_large_norwegian_nynorsk| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|no| +|Size:|3.0 GB| + +## References + +https://huggingface.co/norkart/mt5-large-nn \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_large_norwegian_nynorsk_pipeline_no.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_large_norwegian_nynorsk_pipeline_no.md new file mode 100644 index 00000000000000..322da01c17222e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_large_norwegian_nynorsk_pipeline_no.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Norwegian mt5_large_norwegian_nynorsk_pipeline pipeline T5Transformer from norkart +author: John Snow Labs +name: mt5_large_norwegian_nynorsk_pipeline +date: 2024-08-22 +tags: ["no", open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: "no" +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_large_norwegian_nynorsk_pipeline` is a Norwegian model originally trained by norkart. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_large_norwegian_nynorsk_pipeline_no_5.4.2_3.0_1724287490815.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_large_norwegian_nynorsk_pipeline_no_5.4.2_3.0_1724287490815.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_large_norwegian_nynorsk_pipeline", lang = "no") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_large_norwegian_nynorsk_pipeline", lang = "no") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_large_norwegian_nynorsk_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|no| +|Size:|3.0 GB| + +## References + +https://huggingface.co/norkart/mt5-large-nn + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_py500_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_py500_en.md new file mode 100644 index 00000000000000..4368c0f327bba5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_py500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_py500 T5Transformer from Roy029 +author: John Snow Labs +name: mt5_py500 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_py500` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_py500_en_5.4.2_3.0_1724355026029.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_py500_en_5.4.2_3.0_1724355026029.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_py500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_py500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_py500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Roy029/mt5_py500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_py500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_py500_pipeline_en.md new file mode 100644 index 00000000000000..5266399a7c563c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_py500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_py500_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: mt5_py500_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_py500_pipeline` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_py500_pipeline_en_5.4.2_3.0_1724355191755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_py500_pipeline_en_5.4.2_3.0_1724355191755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_py500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_py500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_py500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Roy029/mt5_py500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_burmese_10k_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_burmese_10k_en.md new file mode 100644 index 00000000000000..41a0c93ff4a3dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_burmese_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_burmese_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_burmese_10k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_burmese_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_burmese_10k_en_5.4.2_3.0_1724330353297.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_burmese_10k_en_5.4.2_3.0_1724330353297.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_burmese_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_burmese_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_burmese_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-my-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_burmese_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_burmese_10k_pipeline_en.md new file mode 100644 index 00000000000000..e9bcd4d9243035 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_burmese_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_burmese_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_burmese_10k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_burmese_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_burmese_10k_pipeline_en_5.4.2_3.0_1724330520395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_burmese_10k_pipeline_en_5.4.2_3.0_1724330520395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_burmese_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_burmese_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_burmese_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-my-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_divehi_10k_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_divehi_10k_en.md new file mode 100644 index 00000000000000..5a3ba7b14dff8d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_divehi_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_divehi_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_divehi_10k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_divehi_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_divehi_10k_en_5.4.2_3.0_1724347368042.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_divehi_10k_en_5.4.2_3.0_1724347368042.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_divehi_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_divehi_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_divehi_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-dv-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_divehi_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_divehi_10k_pipeline_en.md new file mode 100644 index 00000000000000..70aab9fc96ad4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_divehi_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_divehi_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_divehi_10k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_divehi_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_divehi_10k_pipeline_en_5.4.2_3.0_1724347555191.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_divehi_10k_pipeline_en_5.4.2_3.0_1724347555191.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_divehi_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_divehi_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_divehi_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-dv-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_e2e_qg_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_e2e_qg_en.md new file mode 100644 index 00000000000000..be37bcac704c13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_e2e_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_e2e_qg T5Transformer from sangrimlee +author: John Snow Labs +name: mt5_small_e2e_qg +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_e2e_qg` is a English model originally trained by sangrimlee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_e2e_qg_en_5.4.2_3.0_1724292228441.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_e2e_qg_en_5.4.2_3.0_1724292228441.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_e2e_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_e2e_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_e2e_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sangrimlee/mt5-small-e2e-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_e2e_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_e2e_qg_pipeline_en.md new file mode 100644 index 00000000000000..f47c863ed6a121 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_e2e_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_e2e_qg_pipeline pipeline T5Transformer from sangrimlee +author: John Snow Labs +name: mt5_small_e2e_qg_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_e2e_qg_pipeline` is a English model originally trained by sangrimlee. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_e2e_qg_pipeline_en_5.4.2_3.0_1724292416415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_e2e_qg_pipeline_en_5.4.2_3.0_1724292416415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_e2e_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_e2e_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_e2e_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sangrimlee/mt5-small-e2e-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_esquad_qa_trimmed_spanish_90000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_esquad_qa_trimmed_spanish_90000_en.md new file mode 100644 index 00000000000000..96f2ed27362a53 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_esquad_qa_trimmed_spanish_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_esquad_qa_trimmed_spanish_90000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qa_trimmed_spanish_90000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qa_trimmed_spanish_90000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_90000_en_5.4.2_3.0_1724321625185.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_90000_en_5.4.2_3.0_1724321625185.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_esquad_qa_trimmed_spanish_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_esquad_qa_trimmed_spanish_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qa_trimmed_spanish_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|618.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qa-trimmed-es-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_esquad_qa_trimmed_spanish_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_esquad_qa_trimmed_spanish_90000_pipeline_en.md new file mode 100644 index 00000000000000..9ad3e5ddbc894c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_esquad_qa_trimmed_spanish_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_esquad_qa_trimmed_spanish_90000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_esquad_qa_trimmed_spanish_90000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_esquad_qa_trimmed_spanish_90000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_90000_pipeline_en_5.4.2_3.0_1724321659057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_esquad_qa_trimmed_spanish_90000_pipeline_en_5.4.2_3.0_1724321659057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_esquad_qa_trimmed_spanish_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_esquad_qa_trimmed_spanish_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_esquad_qa_trimmed_spanish_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|618.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-esquad-qa-trimmed-es-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_19jan_6_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_19jan_6_en.md new file mode 100644 index 00000000000000..d665011e7a605b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_19jan_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_19jan_6 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_19jan_6 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_19jan_6` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_19jan_6_en_5.4.2_3.0_1724344202208.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_19jan_6_en_5.4.2_3.0_1724344202208.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_19jan_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_19jan_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_19jan_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-19jan-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_19jan_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_19jan_6_pipeline_en.md new file mode 100644 index 00000000000000..8981b67b41a63b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_19jan_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_19jan_6_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_19jan_6_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_19jan_6_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_19jan_6_pipeline_en_5.4.2_3.0_1724344302033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_19jan_6_pipeline_en_5.4.2_3.0_1724344302033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_19jan_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_19jan_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_19jan_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-19jan-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_23feb_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_23feb_2_en.md new file mode 100644 index 00000000000000..a1ccccf97c6fd5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_23feb_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_23feb_2 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_23feb_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_23feb_2` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_23feb_2_en_5.4.2_3.0_1724341207077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_23feb_2_en_5.4.2_3.0_1724341207077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_23feb_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_23feb_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_23feb_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-23feb-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_23feb_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_23feb_2_pipeline_en.md new file mode 100644 index 00000000000000..a82d3f8998c3d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_23feb_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_23feb_2_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_23feb_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_23feb_2_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_23feb_2_pipeline_en_5.4.2_3.0_1724341312961.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_23feb_2_pipeline_en_5.4.2_3.0_1724341312961.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_23feb_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_23feb_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_23feb_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-23feb-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_5feb_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_5feb_1_en.md new file mode 100644 index 00000000000000..3753c718bd42ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_5feb_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_5feb_1 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_5feb_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_5feb_1` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_5feb_1_en_5.4.2_3.0_1724363299001.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_5feb_1_en_5.4.2_3.0_1724363299001.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_5feb_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_5feb_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_5feb_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-5feb-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_5feb_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_5feb_1_pipeline_en.md new file mode 100644 index 00000000000000..bda25501a65617 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_5feb_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_5feb_1_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_5feb_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_5feb_1_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_5feb_1_pipeline_en_5.4.2_3.0_1724363392244.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_5feb_1_pipeline_en_5.4.2_3.0_1724363392244.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_5feb_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_5feb_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_5feb_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-5feb-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_accelerate_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_accelerate_en.md new file mode 100644 index 00000000000000..9a537d4982a41b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_accelerate_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_accelerate T5Transformer from PhysHunter +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_accelerate +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_accelerate` is a English model originally trained by PhysHunter. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_accelerate_en_5.4.2_3.0_1724309902631.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_accelerate_en_5.4.2_3.0_1724309902631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_accelerate","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_accelerate", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_accelerate| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/PhysHunter/mt5-small-finetuned-amazon-en-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_accelerate_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_accelerate_pipeline_en.md new file mode 100644 index 00000000000000..76d122b439b64d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_accelerate_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_accelerate_pipeline pipeline T5Transformer from PhysHunter +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_accelerate_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_accelerate_pipeline` is a English model originally trained by PhysHunter. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_accelerate_pipeline_en_5.4.2_3.0_1724310026892.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_accelerate_pipeline_en_5.4.2_3.0_1724310026892.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_accelerate_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_accelerate_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_accelerate_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/PhysHunter/mt5-small-finetuned-amazon-en-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_german_boaii_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_german_boaii_en.md new file mode 100644 index 00000000000000..3409eedb9ce539 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_german_boaii_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_german_boaii T5Transformer from boaii +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_german_boaii +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_german_boaii` is a English model originally trained by boaii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_boaii_en_5.4.2_3.0_1724359881670.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_boaii_en_5.4.2_3.0_1724359881670.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_german_boaii","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_german_boaii", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_german_boaii| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/boaii/mt5-small-finetuned-amazon-en-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_german_boaii_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_german_boaii_pipeline_en.md new file mode 100644 index 00000000000000..1f57b967bacdf6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_german_boaii_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_german_boaii_pipeline pipeline T5Transformer from boaii +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_german_boaii_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_german_boaii_pipeline` is a English model originally trained by boaii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_boaii_pipeline_en_5.4.2_3.0_1724359999421.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_german_boaii_pipeline_en_5.4.2_3.0_1724359999421.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_german_boaii_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_german_boaii_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_german_boaii_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/boaii/mt5-small-finetuned-amazon-en-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_arham061_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_arham061_en.md new file mode 100644 index 00000000000000..bafd2e2aaae9b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_arham061_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_arham061 T5Transformer from arham061 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_arham061 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_arham061` is a English model originally trained by arham061. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_arham061_en_5.4.2_3.0_1724351386431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_arham061_en_5.4.2_3.0_1724351386431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_arham061","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_arham061", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_arham061| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/arham061/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_arham061_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_arham061_pipeline_en.md new file mode 100644 index 00000000000000..ff9958c82300bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_arham061_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_arham061_pipeline pipeline T5Transformer from arham061 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_arham061_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_arham061_pipeline` is a English model originally trained by arham061. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_arham061_pipeline_en_5.4.2_3.0_1724351485862.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_arham061_pipeline_en_5.4.2_3.0_1724351485862.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_arham061_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_arham061_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_arham061_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/arham061/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_cyrexpro_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_cyrexpro_en.md new file mode 100644 index 00000000000000..fb0768c9d3540a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_cyrexpro_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_cyrexpro T5Transformer from CyrexPro +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_cyrexpro +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_cyrexpro` is a English model originally trained by CyrexPro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_cyrexpro_en_5.4.2_3.0_1724295551422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_cyrexpro_en_5.4.2_3.0_1724295551422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_cyrexpro","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_cyrexpro", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_cyrexpro| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/CyrexPro/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline_en.md new file mode 100644 index 00000000000000..847e46ba9a5762 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline pipeline T5Transformer from CyrexPro +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline` is a English model originally trained by CyrexPro. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline_en_5.4.2_3.0_1724295642564.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline_en_5.4.2_3.0_1724295642564.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_cyrexpro_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/CyrexPro/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_doktan_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_doktan_en.md new file mode 100644 index 00000000000000..ad1abf360384d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_doktan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_doktan T5Transformer from doktan +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_doktan +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_doktan` is a English model originally trained by doktan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_doktan_en_5.4.2_3.0_1724293178228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_doktan_en_5.4.2_3.0_1724293178228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_doktan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_doktan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_doktan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/doktan/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_doktan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_doktan_pipeline_en.md new file mode 100644 index 00000000000000..43df87db5401ea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_doktan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_doktan_pipeline pipeline T5Transformer from doktan +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_doktan_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_doktan_pipeline` is a English model originally trained by doktan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_doktan_pipeline_en_5.4.2_3.0_1724293301628.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_doktan_pipeline_en_5.4.2_3.0_1724293301628.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_doktan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_doktan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_doktan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/doktan/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_johnyyhk_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_johnyyhk_en.md new file mode 100644 index 00000000000000..80a76984a7a1e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_johnyyhk_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_johnyyhk T5Transformer from johnyyhk +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_johnyyhk +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_johnyyhk` is a English model originally trained by johnyyhk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_johnyyhk_en_5.4.2_3.0_1724302536718.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_johnyyhk_en_5.4.2_3.0_1724302536718.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_johnyyhk","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_johnyyhk", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_johnyyhk| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/johnyyhk/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline_en.md new file mode 100644 index 00000000000000..f11f17d6c717bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline pipeline T5Transformer from johnyyhk +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline` is a English model originally trained by johnyyhk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline_en_5.4.2_3.0_1724302637912.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline_en_5.4.2_3.0_1724302637912.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_johnyyhk_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/johnyyhk/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_magnustragardh_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_magnustragardh_en.md new file mode 100644 index 00000000000000..76ed25980abc55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_magnustragardh_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_magnustragardh T5Transformer from magnustragardh +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_magnustragardh +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_magnustragardh` is a English model originally trained by magnustragardh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_magnustragardh_en_5.4.2_3.0_1724334107865.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_magnustragardh_en_5.4.2_3.0_1724334107865.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_magnustragardh","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_magnustragardh", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_magnustragardh| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/magnustragardh/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline_en.md new file mode 100644 index 00000000000000..3d6d266f18b68a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline pipeline T5Transformer from magnustragardh +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline` is a English model originally trained by magnustragardh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline_en_5.4.2_3.0_1724334197649.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline_en_5.4.2_3.0_1724334197649.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_magnustragardh_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/magnustragardh/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_en.md new file mode 100644 index 00000000000000..2aa850d63aeb40 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_vibharkchauhan T5Transformer from Vibharkchauhan +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_vibharkchauhan +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_vibharkchauhan` is a English model originally trained by Vibharkchauhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_en_5.4.2_3.0_1724361791491.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_en_5.4.2_3.0_1724361791491.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_vibharkchauhan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_vibharkchauhan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_vibharkchauhan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Vibharkchauhan/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline_en.md new file mode 100644 index 00000000000000..f61a66a5c1a0a5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline pipeline T5Transformer from Vibharkchauhan +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline` is a English model originally trained by Vibharkchauhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline_en_5.4.2_3.0_1724361888383.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline_en_5.4.2_3.0_1724361888383.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_vibharkchauhan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Vibharkchauhan/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_en.md new file mode 100644 index 00000000000000..b4f1e90ad9820d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_arabic_tonga_tonga_islands_thai T5Transformer from Shularp +author: John Snow Labs +name: mt5_small_finetuned_arabic_tonga_tonga_islands_thai +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_arabic_tonga_tonga_islands_thai` is a English model originally trained by Shularp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_arabic_tonga_tonga_islands_thai_en_5.4.2_3.0_1724301257520.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_arabic_tonga_tonga_islands_thai_en_5.4.2_3.0_1724301257520.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_arabic_tonga_tonga_islands_thai","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_arabic_tonga_tonga_islands_thai", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_arabic_tonga_tonga_islands_thai| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Shularp/mt5-small-finetuned-ar-to-th \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline_en.md new file mode 100644 index 00000000000000..25f9bb6bfd8609 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline pipeline T5Transformer from Shularp +author: John Snow Labs +name: mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline` is a English model originally trained by Shularp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline_en_5.4.2_3.0_1724301351460.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline_en_5.4.2_3.0_1724301351460.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_arabic_tonga_tonga_islands_thai_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Shularp/mt5-small-finetuned-ar-to-th + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_hindi_tonga_tonga_islands_english_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_hindi_tonga_tonga_islands_english_en.md new file mode 100644 index 00000000000000..b226ad16205915 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_hindi_tonga_tonga_islands_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_hindi_tonga_tonga_islands_english T5Transformer from danhsf +author: John Snow Labs +name: mt5_small_finetuned_hindi_tonga_tonga_islands_english +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_hindi_tonga_tonga_islands_english` is a English model originally trained by danhsf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_hindi_tonga_tonga_islands_english_en_5.4.2_3.0_1724286505767.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_hindi_tonga_tonga_islands_english_en_5.4.2_3.0_1724286505767.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_hindi_tonga_tonga_islands_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_hindi_tonga_tonga_islands_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_hindi_tonga_tonga_islands_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/danhsf/mt5-small-finetuned-hi-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline_en.md new file mode 100644 index 00000000000000..cabae2acb6a428 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline pipeline T5Transformer from danhsf +author: John Snow Labs +name: mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline` is a English model originally trained by danhsf. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724286782668.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724286782668.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_hindi_tonga_tonga_islands_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/danhsf/mt5-small-finetuned-hi-to-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generation_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generation_en.md new file mode 100644 index 00000000000000..c7506bf32ea9ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_lyric_generation T5Transformer from ShushantLLM +author: John Snow Labs +name: mt5_small_finetuned_lyric_generation +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_lyric_generation` is a English model originally trained by ShushantLLM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_lyric_generation_en_5.4.2_3.0_1724353836503.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_lyric_generation_en_5.4.2_3.0_1724353836503.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_lyric_generation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_lyric_generation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_lyric_generation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/ShushantLLM/mt5-small-finetuned-lyric-generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generation_pipeline_en.md new file mode 100644 index 00000000000000..9495a0f020f316 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_lyric_generation_pipeline pipeline T5Transformer from ShushantLLM +author: John Snow Labs +name: mt5_small_finetuned_lyric_generation_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_lyric_generation_pipeline` is a English model originally trained by ShushantLLM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_lyric_generation_pipeline_en_5.4.2_3.0_1724353943321.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_lyric_generation_pipeline_en_5.4.2_3.0_1724353943321.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_lyric_generation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_lyric_generation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_lyric_generation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/ShushantLLM/mt5-small-finetuned-lyric-generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generationnewest2_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generationnewest2_en.md new file mode 100644 index 00000000000000..a5bc4afa58b61d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generationnewest2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_lyric_generationnewest2 T5Transformer from ShushantLLM +author: John Snow Labs +name: mt5_small_finetuned_lyric_generationnewest2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_lyric_generationnewest2` is a English model originally trained by ShushantLLM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_lyric_generationnewest2_en_5.4.2_3.0_1724369385972.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_lyric_generationnewest2_en_5.4.2_3.0_1724369385972.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_lyric_generationnewest2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_lyric_generationnewest2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_lyric_generationnewest2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/ShushantLLM/mt5-small-finetuned-lyric-generationNewest2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generationnewest2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generationnewest2_pipeline_en.md new file mode 100644 index 00000000000000..7ea2b438553940 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_lyric_generationnewest2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_lyric_generationnewest2_pipeline pipeline T5Transformer from ShushantLLM +author: John Snow Labs +name: mt5_small_finetuned_lyric_generationnewest2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_lyric_generationnewest2_pipeline` is a English model originally trained by ShushantLLM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_lyric_generationnewest2_pipeline_en_5.4.2_3.0_1724369669826.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_lyric_generationnewest2_pipeline_en_5.4.2_3.0_1724369669826.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_lyric_generationnewest2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_lyric_generationnewest2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_lyric_generationnewest2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/ShushantLLM/mt5-small-finetuned-lyric-generationNewest2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_multihead_230207_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_multihead_230207_en.md new file mode 100644 index 00000000000000..135e4c79c6f824 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_multihead_230207_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_multihead_230207 T5Transformer from HealthTeam +author: John Snow Labs +name: mt5_small_finetuned_multihead_230207 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_multihead_230207` is a English model originally trained by HealthTeam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230207_en_5.4.2_3.0_1724336024004.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230207_en_5.4.2_3.0_1724336024004.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_multihead_230207","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_multihead_230207", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_multihead_230207| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/HealthTeam/mt5-small-finetuned-MultiHead-230207 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_multihead_230207_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_multihead_230207_pipeline_en.md new file mode 100644 index 00000000000000..f91d53f70e62b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_multihead_230207_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_multihead_230207_pipeline pipeline T5Transformer from HealthTeam +author: John Snow Labs +name: mt5_small_finetuned_multihead_230207_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_multihead_230207_pipeline` is a English model originally trained by HealthTeam. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230207_pipeline_en_5.4.2_3.0_1724336110937.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_multihead_230207_pipeline_en_5.4.2_3.0_1724336110937.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_multihead_230207_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_multihead_230207_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_multihead_230207_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/HealthTeam/mt5-small-finetuned-MultiHead-230207 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_nepali_health_50k_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_nepali_health_50k_en.md new file mode 100644 index 00000000000000..e5fa2ede18bbfd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_nepali_health_50k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_nepali_health_50k T5Transformer from NepaliAI +author: John Snow Labs +name: mt5_small_finetuned_nepali_health_50k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_nepali_health_50k` is a English model originally trained by NepaliAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_nepali_health_50k_en_5.4.2_3.0_1724351489363.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_nepali_health_50k_en_5.4.2_3.0_1724351489363.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_nepali_health_50k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_nepali_health_50k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_nepali_health_50k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/NepaliAI/mt5-small-finetuned-Nepali-Health-50k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_nepali_health_50k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_nepali_health_50k_pipeline_en.md new file mode 100644 index 00000000000000..c5b985e5e6dcac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_nepali_health_50k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_nepali_health_50k_pipeline pipeline T5Transformer from NepaliAI +author: John Snow Labs +name: mt5_small_finetuned_nepali_health_50k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_nepali_health_50k_pipeline` is a English model originally trained by NepaliAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_nepali_health_50k_pipeline_en_5.4.2_3.0_1724351585444.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_nepali_health_50k_pipeline_en_5.4.2_3.0_1724351585444.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_nepali_health_50k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_nepali_health_50k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_nepali_health_50k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/NepaliAI/mt5-small-finetuned-Nepali-Health-50k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xlsum_russian_english_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xlsum_russian_english_en.md new file mode 100644 index 00000000000000..a02069d6320f59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xlsum_russian_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_xlsum_russian_english T5Transformer from doktan +author: John Snow Labs +name: mt5_small_finetuned_xlsum_russian_english +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_xlsum_russian_english` is a English model originally trained by doktan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xlsum_russian_english_en_5.4.2_3.0_1724309090448.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xlsum_russian_english_en_5.4.2_3.0_1724309090448.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_xlsum_russian_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_xlsum_russian_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_xlsum_russian_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/doktan/mt5-small-finetuned-xlsum-ru-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xlsum_russian_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xlsum_russian_english_pipeline_en.md new file mode 100644 index 00000000000000..d51d543a3cc7a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xlsum_russian_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_xlsum_russian_english_pipeline pipeline T5Transformer from doktan +author: John Snow Labs +name: mt5_small_finetuned_xlsum_russian_english_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_xlsum_russian_english_pipeline` is a English model originally trained by doktan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xlsum_russian_english_pipeline_en_5.4.2_3.0_1724309177652.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xlsum_russian_english_pipeline_en_5.4.2_3.0_1724309177652.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_xlsum_russian_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_xlsum_russian_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_xlsum_russian_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 GB| + +## References + +https://huggingface.co/doktan/mt5-small-finetuned-xlsum-ru-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xsum_tdperez_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xsum_tdperez_en.md new file mode 100644 index 00000000000000..ce5ba12ed654f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xsum_tdperez_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_xsum_tdperez T5Transformer from tdperez +author: John Snow Labs +name: mt5_small_finetuned_xsum_tdperez +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_xsum_tdperez` is a English model originally trained by tdperez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xsum_tdperez_en_5.4.2_3.0_1724359874859.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xsum_tdperez_en_5.4.2_3.0_1724359874859.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_xsum_tdperez","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_xsum_tdperez", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_xsum_tdperez| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|997.1 MB| + +## References + +https://huggingface.co/tdperez/mt5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xsum_tdperez_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xsum_tdperez_pipeline_en.md new file mode 100644 index 00000000000000..2ad9269d53424c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_finetuned_xsum_tdperez_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_xsum_tdperez_pipeline pipeline T5Transformer from tdperez +author: John Snow Labs +name: mt5_small_finetuned_xsum_tdperez_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_xsum_tdperez_pipeline` is a English model originally trained by tdperez. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xsum_tdperez_pipeline_en_5.4.2_3.0_1724360013928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xsum_tdperez_pipeline_en_5.4.2_3.0_1724360013928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_xsum_tdperez_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_xsum_tdperez_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_xsum_tdperez_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|997.1 MB| + +## References + +https://huggingface.co/tdperez/mt5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_5000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_5000_en.md new file mode 100644 index 00000000000000..9f7bfcd6c75adb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_5000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_5000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_5000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_5000_en_5.4.2_3.0_1724331710015.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_5000_en_5.4.2_3.0_1724331710015.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|195.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_5000_pipeline_en.md new file mode 100644 index 00000000000000..95f5cfa94b3a63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_5000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_5000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_5000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_5000_pipeline_en_5.4.2_3.0_1724331719920.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_5000_pipeline_en_5.4.2_3.0_1724331719920.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|195.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_60000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_60000_en.md new file mode 100644 index 00000000000000..c5cebd28e025f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_60000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_60000_en_5.4.2_3.0_1724332740804.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_60000_en_5.4.2_3.0_1724332740804.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|456.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_60000_pipeline_en.md new file mode 100644 index 00000000000000..4797fd17d99677 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_60000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_60000_pipeline_en_5.4.2_3.0_1724332768322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_60000_pipeline_en_5.4.2_3.0_1724332768322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|456.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_en.md new file mode 100644 index 00000000000000..c6970e10b7277c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_en_5.4.2_3.0_1724356553883.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_en_5.4.2_3.0_1724356553883.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_frquad_qg_trimmed_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|746.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_pipeline_en.md new file mode 100644 index 00000000000000..67f6a5f2ccdb96 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_frquad_qg_trimmed_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_frquad_qg_trimmed_french_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_frquad_qg_trimmed_french_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_frquad_qg_trimmed_french_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_pipeline_en_5.4.2_3.0_1724356606776.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_frquad_qg_trimmed_french_pipeline_en_5.4.2_3.0_1724356606776.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_frquad_qg_trimmed_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_frquad_qg_trimmed_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|746.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-frquad-qg-trimmed-fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_jaquad_qa_trimmed_japanese_10000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_jaquad_qa_trimmed_japanese_10000_en.md new file mode 100644 index 00000000000000..fe1ea96542220d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_jaquad_qa_trimmed_japanese_10000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_jaquad_qa_trimmed_japanese_10000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qa_trimmed_japanese_10000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qa_trimmed_japanese_10000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_trimmed_japanese_10000_en_5.4.2_3.0_1724287304409.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_trimmed_japanese_10000_en_5.4.2_3.0_1724287304409.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_jaquad_qa_trimmed_japanese_10000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_jaquad_qa_trimmed_japanese_10000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qa_trimmed_japanese_10000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|223.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qa-trimmed-ja-10000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline_en.md new file mode 100644 index 00000000000000..80867eeb5ff2d1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline_en_5.4.2_3.0_1724287315320.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline_en_5.4.2_3.0_1724287315320.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_jaquad_qa_trimmed_japanese_10000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|223.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-jaquad-qa-trimmed-ja-10000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_nc16_250k_ende_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_nc16_250k_ende_en.md new file mode 100644 index 00000000000000..216451ed827514 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_nc16_250k_ende_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_250k_ende T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_250k_ende +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_250k_ende` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_ende_en_5.4.2_3.0_1724349674436.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_ende_en_5.4.2_3.0_1724349674436.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_250k_ende","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_250k_ende", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_250k_ende| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-250k-ende \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_nc16_250k_ende_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_nc16_250k_ende_pipeline_en.md new file mode 100644 index 00000000000000..8fc9ea223d80f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_nc16_250k_ende_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_250k_ende_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_250k_ende_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_250k_ende_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_ende_pipeline_en_5.4.2_3.0_1724349839321.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_250k_ende_pipeline_en_5.4.2_3.0_1724349839321.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_250k_ende_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_250k_ende_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_250k_ende_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-250k-ende + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_normail_gold_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_normail_gold_en.md new file mode 100644 index 00000000000000..55ea456b7564fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_normail_gold_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_normail_gold T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: mt5_small_normail_gold +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_normail_gold` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_normail_gold_en_5.4.2_3.0_1724305994806.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_normail_gold_en_5.4.2_3.0_1724305994806.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_normail_gold","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_normail_gold", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_normail_gold| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/mt5_small-normail_gold \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_normail_gold_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_normail_gold_pipeline_en.md new file mode 100644 index 00000000000000..7adbde28282110 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_normail_gold_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_normail_gold_pipeline pipeline T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: mt5_small_normail_gold_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_normail_gold_pipeline` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_normail_gold_pipeline_en_5.4.2_3.0_1724306196219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_normail_gold_pipeline_en_5.4.2_3.0_1724306196219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_normail_gold_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_normail_gold_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_normail_gold_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.1 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/mt5_small-normail_gold + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_polish_10k_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_polish_10k_en.md new file mode 100644 index 00000000000000..1b5c4ae2d17c32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_polish_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_polish_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_polish_10k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_polish_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_polish_10k_en_5.4.2_3.0_1724324914916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_polish_10k_en_5.4.2_3.0_1724324914916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_polish_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_polish_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_polish_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-pl-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_polish_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_polish_10k_pipeline_en.md new file mode 100644 index 00000000000000..0abb7e29e0a4e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_polish_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_polish_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_polish_10k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_polish_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_polish_10k_pipeline_en_5.4.2_3.0_1724325074786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_polish_10k_pipeline_en_5.4.2_3.0_1724325074786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_polish_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_polish_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_polish_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-pl-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_portuguese_10k_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_portuguese_10k_en.md new file mode 100644 index 00000000000000..0237566f646a65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_portuguese_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_portuguese_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_portuguese_10k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_portuguese_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_portuguese_10k_en_5.4.2_3.0_1724327402489.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_portuguese_10k_en_5.4.2_3.0_1724327402489.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_portuguese_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_portuguese_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_portuguese_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-pt-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_portuguese_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_portuguese_10k_pipeline_en.md new file mode 100644 index 00000000000000..5af054062a8909 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_portuguese_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_portuguese_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_portuguese_10k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_portuguese_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_portuguese_10k_pipeline_en_5.4.2_3.0_1724327552735.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_portuguese_10k_pipeline_en_5.4.2_3.0_1724327552735.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_portuguese_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_portuguese_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_portuguese_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-pt-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_punjabi_eastern_10k_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_punjabi_eastern_10k_en.md new file mode 100644 index 00000000000000..5169dd75d647d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_punjabi_eastern_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_punjabi_eastern_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_punjabi_eastern_10k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_punjabi_eastern_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_punjabi_eastern_10k_en_5.4.2_3.0_1724300710643.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_punjabi_eastern_10k_en_5.4.2_3.0_1724300710643.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_punjabi_eastern_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_punjabi_eastern_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_punjabi_eastern_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-pa-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_punjabi_eastern_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_punjabi_eastern_10k_pipeline_en.md new file mode 100644 index 00000000000000..656c8fb0462583 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_punjabi_eastern_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_punjabi_eastern_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_punjabi_eastern_10k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_punjabi_eastern_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_punjabi_eastern_10k_pipeline_en_5.4.2_3.0_1724300873900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_punjabi_eastern_10k_pipeline_en_5.4.2_3.0_1724300873900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_punjabi_eastern_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_punjabi_eastern_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_punjabi_eastern_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-pa-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..a964e388ccc4a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_ruquad_qg_ae_trimmed_50000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724290410174.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724290410174.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|418.5 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-ruquad-qg-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..a8827433e3fbfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_small_ruquad_qg_ae_trimmed_50000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724290433395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724290433395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_qg_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_qg_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|418.5 MB| + +## References + +https://huggingface.co/lmqg/mt5-small-ruquad-qg-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_trimmed_russian_30000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_trimmed_russian_30000_en.md new file mode 100644 index 00000000000000..998a08c42ca3fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_trimmed_russian_30000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_30000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_30000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_30000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_30000_en_5.4.2_3.0_1724289895051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_30000_en_5.4.2_3.0_1724289895051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian_30000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_ruquad_qg_trimmed_russian_30000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_30000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|330.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru-30000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_trimmed_russian_30000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_trimmed_russian_30000_pipeline_en.md new file mode 100644 index 00000000000000..69dc9385e5afe8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_ruquad_qg_trimmed_russian_30000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_ruquad_qg_trimmed_russian_30000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_ruquad_qg_trimmed_russian_30000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_ruquad_qg_trimmed_russian_30000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_30000_pipeline_en_5.4.2_3.0_1724289911061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_ruquad_qg_trimmed_russian_30000_pipeline_en_5.4.2_3.0_1724289911061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_30000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_ruquad_qg_trimmed_russian_30000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_ruquad_qg_trimmed_russian_30000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|330.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-ruquad-qg-trimmed-ru-30000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_squad_qg_trimmed_english_90000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_squad_qg_trimmed_english_90000_en.md new file mode 100644 index 00000000000000..e44bc612a20ed1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_squad_qg_trimmed_english_90000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_squad_qg_trimmed_english_90000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qg_trimmed_english_90000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qg_trimmed_english_90000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_90000_en_5.4.2_3.0_1724333129219.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_90000_en_5.4.2_3.0_1724333129219.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_squad_qg_trimmed_english_90000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_squad_qg_trimmed_english_90000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qg_trimmed_english_90000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|621.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qg-trimmed-en-90000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_squad_qg_trimmed_english_90000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_squad_qg_trimmed_english_90000_pipeline_en.md new file mode 100644 index 00000000000000..2929fd7e1d7792 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_squad_qg_trimmed_english_90000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_squad_qg_trimmed_english_90000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_squad_qg_trimmed_english_90000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_squad_qg_trimmed_english_90000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_90000_pipeline_en_5.4.2_3.0_1724333162202.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_squad_qg_trimmed_english_90000_pipeline_en_5.4.2_3.0_1724333162202.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_squad_qg_trimmed_english_90000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_squad_qg_trimmed_english_90000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_squad_qg_trimmed_english_90000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|621.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-squad-qg-trimmed-en-90000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tagalog_10k_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tagalog_10k_en.md new file mode 100644 index 00000000000000..d92172377df16f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tagalog_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_tagalog_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_tagalog_10k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tagalog_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tagalog_10k_en_5.4.2_3.0_1724351635531.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tagalog_10k_en_5.4.2_3.0_1724351635531.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_tagalog_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_tagalog_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tagalog_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-tl-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tagalog_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tagalog_10k_pipeline_en.md new file mode 100644 index 00000000000000..5c1d7c9ab77ae6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tagalog_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_tagalog_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_tagalog_10k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tagalog_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tagalog_10k_pipeline_en_5.4.2_3.0_1724351782007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tagalog_10k_pipeline_en_5.4.2_3.0_1724351782007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_tagalog_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_tagalog_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tagalog_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-tl-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tamil_10k_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tamil_10k_en.md new file mode 100644 index 00000000000000..05d938bd98275f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tamil_10k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_tamil_10k T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_tamil_10k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tamil_10k` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tamil_10k_en_5.4.2_3.0_1724289951950.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tamil_10k_en_5.4.2_3.0_1724289951950.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_tamil_10k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_tamil_10k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tamil_10k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ta-10k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tamil_10k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tamil_10k_pipeline_en.md new file mode 100644 index 00000000000000..c646b59634d590 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_tamil_10k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_tamil_10k_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: mt5_small_tamil_10k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_tamil_10k_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_tamil_10k_pipeline_en_5.4.2_3.0_1724290111266.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_tamil_10k_pipeline_en_5.4.2_3.0_1724290111266.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_tamil_10k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_tamil_10k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_tamil_10k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/KaiNylund/mt5-small-ta-10k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thai_translation_thai_english_english_thai_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thai_translation_thai_english_english_thai_v2_en.md new file mode 100644 index 00000000000000..3271807abe6388 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thai_translation_thai_english_english_thai_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_thai_translation_thai_english_english_thai_v2 T5Transformer from SuperAI2-Machima +author: John Snow Labs +name: mt5_small_thai_translation_thai_english_english_thai_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_thai_translation_thai_english_english_thai_v2` is a English model originally trained by SuperAI2-Machima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_thai_translation_thai_english_english_thai_v2_en_5.4.2_3.0_1724296733757.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_thai_translation_thai_english_english_thai_v2_en_5.4.2_3.0_1724296733757.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_thai_translation_thai_english_english_thai_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_thai_translation_thai_english_english_thai_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_thai_translation_thai_english_english_thai_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/SuperAI2-Machima/mt5-small-thai_translation_th-en_en-th_V2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thai_translation_thai_english_english_thai_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thai_translation_thai_english_english_thai_v2_pipeline_en.md new file mode 100644 index 00000000000000..e826c4ef3d5751 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thai_translation_thai_english_english_thai_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_thai_translation_thai_english_english_thai_v2_pipeline pipeline T5Transformer from SuperAI2-Machima +author: John Snow Labs +name: mt5_small_thai_translation_thai_english_english_thai_v2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_thai_translation_thai_english_english_thai_v2_pipeline` is a English model originally trained by SuperAI2-Machima. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_thai_translation_thai_english_english_thai_v2_pipeline_en_5.4.2_3.0_1724296825229.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_thai_translation_thai_english_english_thai_v2_pipeline_en_5.4.2_3.0_1724296825229.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_thai_translation_thai_english_english_thai_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_thai_translation_thai_english_english_thai_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_thai_translation_thai_english_english_thai_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/SuperAI2-Machima/mt5-small-thai_translation_th-en_en-th_V2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thaisum_nopphakorn_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thaisum_nopphakorn_en.md new file mode 100644 index 00000000000000..3457593eb01d85 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thaisum_nopphakorn_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_thaisum_nopphakorn T5Transformer from Nopphakorn +author: John Snow Labs +name: mt5_small_thaisum_nopphakorn +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_thaisum_nopphakorn` is a English model originally trained by Nopphakorn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_thaisum_nopphakorn_en_5.4.2_3.0_1724364600121.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_thaisum_nopphakorn_en_5.4.2_3.0_1724364600121.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_thaisum_nopphakorn","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_thaisum_nopphakorn", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_thaisum_nopphakorn| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Nopphakorn/mt5-small-thaisum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thaisum_nopphakorn_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thaisum_nopphakorn_pipeline_en.md new file mode 100644 index 00000000000000..bfa613c98dc9fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_thaisum_nopphakorn_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_thaisum_nopphakorn_pipeline pipeline T5Transformer from Nopphakorn +author: John Snow Labs +name: mt5_small_thaisum_nopphakorn_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_thaisum_nopphakorn_pipeline` is a English model originally trained by Nopphakorn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_thaisum_nopphakorn_pipeline_en_5.4.2_3.0_1724364691633.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_thaisum_nopphakorn_pipeline_en_5.4.2_3.0_1724364691633.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_thaisum_nopphakorn_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_thaisum_nopphakorn_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_thaisum_nopphakorn_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/Nopphakorn/mt5-small-thaisum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_english_10000_squad_qa_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_english_10000_squad_qa_en.md new file mode 100644 index 00000000000000..df94bd5d0e5a99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_english_10000_squad_qa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_10000_squad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_10000_squad_qa +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_10000_squad_qa` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_squad_qa_en_5.4.2_3.0_1724353398717.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_squad_qa_en_5.4.2_3.0_1724353398717.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_10000_squad_qa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_10000_squad_qa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_10000_squad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|224.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-10000-squad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_english_10000_squad_qa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_english_10000_squad_qa_pipeline_en.md new file mode 100644 index 00000000000000..e571cb23337065 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_english_10000_squad_qa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_10000_squad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_10000_squad_qa_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_10000_squad_qa_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_squad_qa_pipeline_en_5.4.2_3.0_1724353410773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_10000_squad_qa_pipeline_en_5.4.2_3.0_1724353410773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_10000_squad_qa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_10000_squad_qa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_10000_squad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|224.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-10000-squad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_120000_frquad_qg_fr.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_120000_frquad_qg_fr.md new file mode 100644 index 00000000000000..383a0c60dddd82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_120000_frquad_qg_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_120000_frquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_120000_frquad_qg +date: 2024-08-22 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_120000_frquad_qg` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_frquad_qg_fr_5.4.2_3.0_1724370442169.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_frquad_qg_fr_5.4.2_3.0_1724370442169.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_120000_frquad_qg","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_120000_frquad_qg", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_120000_frquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|702.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-120000-frquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_120000_frquad_qg_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_120000_frquad_qg_pipeline_fr.md new file mode 100644 index 00000000000000..a3bbcd094c06e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_120000_frquad_qg_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_120000_frquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_120000_frquad_qg_pipeline +date: 2024-08-22 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_120000_frquad_qg_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_frquad_qg_pipeline_fr_5.4.2_3.0_1724370488620.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_frquad_qg_pipeline_fr_5.4.2_3.0_1724370488620.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_120000_frquad_qg_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_120000_frquad_qg_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_120000_frquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|702.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-120000-frquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_15000_frquad_qg_fr.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_15000_frquad_qg_fr.md new file mode 100644 index 00000000000000..4808d5328fe88f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_15000_frquad_qg_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_15000_frquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_15000_frquad_qg +date: 2024-08-22 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_15000_frquad_qg` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_15000_frquad_qg_fr_5.4.2_3.0_1724326189754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_15000_frquad_qg_fr_5.4.2_3.0_1724326189754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_15000_frquad_qg","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_15000_frquad_qg", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_15000_frquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|250.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-15000-frquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_15000_frquad_qg_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_15000_frquad_qg_pipeline_fr.md new file mode 100644 index 00000000000000..666e09c61e8e6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_french_15000_frquad_qg_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_15000_frquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_15000_frquad_qg_pipeline +date: 2024-08-22 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_15000_frquad_qg_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_15000_frquad_qg_pipeline_fr_5.4.2_3.0_1724326202148.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_15000_frquad_qg_pipeline_fr_5.4.2_3.0_1724326202148.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_15000_frquad_qg_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_15000_frquad_qg_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_15000_frquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|250.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-15000-frquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_5000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_5000_en.md new file mode 100644 index 00000000000000..d9b5bca7430eb3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_italian_5000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_5000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_5000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_5000_en_5.4.2_3.0_1724341171102.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_5000_en_5.4.2_3.0_1724341171102.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|101.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_5000_pipeline_en.md new file mode 100644 index 00000000000000..2680180dab7aa2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_italian_5000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_5000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_5000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_5000_pipeline_en_5.4.2_3.0_1724341204719.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_5000_pipeline_en_5.4.2_3.0_1724341204719.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_italian_5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_italian_5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|101.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_90000_itquad_qg_it.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_90000_itquad_qg_it.md new file mode 100644 index 00000000000000..9a23fb536b016d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_90000_itquad_qg_it.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Italian mt5_small_trimmed_italian_90000_itquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_90000_itquad_qg +date: 2024-08-22 +tags: [it, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_90000_itquad_qg` is a Italian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_90000_itquad_qg_it_5.4.2_3.0_1724305457367.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_90000_itquad_qg_it_5.4.2_3.0_1724305457367.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_90000_itquad_qg","it") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_italian_90000_itquad_qg", "it") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_90000_itquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|it| +|Size:|614.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-90000-itquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_90000_itquad_qg_pipeline_it.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_90000_itquad_qg_pipeline_it.md new file mode 100644 index 00000000000000..7717b92f358274 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_italian_90000_itquad_qg_pipeline_it.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Italian mt5_small_trimmed_italian_90000_itquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_italian_90000_itquad_qg_pipeline +date: 2024-08-22 +tags: [it, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: it +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_italian_90000_itquad_qg_pipeline` is a Italian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_90000_itquad_qg_pipeline_it_5.4.2_3.0_1724305491414.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_italian_90000_itquad_qg_pipeline_it_5.4.2_3.0_1724305491414.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_italian_90000_itquad_qg_pipeline", lang = "it") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_italian_90000_itquad_qg_pipeline", lang = "it") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_italian_90000_itquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|it| +|Size:|614.9 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-it-90000-itquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_japanese_5000_jaquad_qg_ja.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_japanese_5000_jaquad_qg_ja.md new file mode 100644 index 00000000000000..09a1f76362f1e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_japanese_5000_jaquad_qg_ja.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_5000_jaquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_5000_jaquad_qg +date: 2024-08-22 +tags: [ja, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_5000_jaquad_qg` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_5000_jaquad_qg_ja_5.4.2_3.0_1724286547835.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_5000_jaquad_qg_ja_5.4.2_3.0_1724286547835.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_5000_jaquad_qg","ja") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_japanese_5000_jaquad_qg", "ja") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_5000_jaquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ja| +|Size:|195.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-5000-jaquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline_ja.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline_ja.md new file mode 100644 index 00000000000000..13187891796b38 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline_ja.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Japanese mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline +date: 2024-08-22 +tags: [ja, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ja +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline` is a Japanese model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724286556946.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline_ja_5.4.2_3.0_1724286556946.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline", lang = "ja") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline", lang = "ja") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_japanese_5000_jaquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ja| +|Size:|195.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ja-5000-jaquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_60000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_60000_en.md new file mode 100644 index 00000000000000..453417bebd7e9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_korean_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_60000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_60000_en_5.4.2_3.0_1724352426030.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_60000_en_5.4.2_3.0_1724352426030.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|262.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_60000_pipeline_en.md new file mode 100644 index 00000000000000..8f74c435d0c432 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_korean_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_60000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_60000_pipeline_en_5.4.2_3.0_1724352517558.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_60000_pipeline_en_5.4.2_3.0_1724352517558.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_korean_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_korean_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|262.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_koquad_qa_ko.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_koquad_qa_ko.md new file mode 100644 index 00000000000000..743290c5c3a2c3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_koquad_qa_ko.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Korean mt5_small_trimmed_korean_koquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_koquad_qa +date: 2024-08-22 +tags: [ko, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_koquad_qa` is a Korean model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_koquad_qa_ko_5.4.2_3.0_1724347737294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_koquad_qa_ko_5.4.2_3.0_1724347737294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_koquad_qa","ko") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_korean_koquad_qa", "ko") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_koquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ko| +|Size:|505.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-koquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_koquad_qa_pipeline_ko.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_koquad_qa_pipeline_ko.md new file mode 100644 index 00000000000000..79e74f4cc50ae7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_korean_koquad_qa_pipeline_ko.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Korean mt5_small_trimmed_korean_koquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_korean_koquad_qa_pipeline +date: 2024-08-22 +tags: [ko, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ko +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_korean_koquad_qa_pipeline` is a Korean model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_koquad_qa_pipeline_ko_5.4.2_3.0_1724347768880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_korean_koquad_qa_pipeline_ko_5.4.2_3.0_1724347768880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_korean_koquad_qa_pipeline", lang = "ko") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_korean_koquad_qa_pipeline", lang = "ko") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_korean_koquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ko| +|Size:|505.4 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ko-koquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_15000_ruquad_qg_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_15000_ruquad_qg_pipeline_ru.md new file mode 100644 index 00000000000000..d662b8bd8f190f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_15000_ruquad_qg_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_15000_ruquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_15000_ruquad_qg_pipeline +date: 2024-08-22 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_15000_ruquad_qg_pipeline` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_15000_ruquad_qg_pipeline_ru_5.4.2_3.0_1724313624965.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_15000_ruquad_qg_pipeline_ru_5.4.2_3.0_1724313624965.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_15000_ruquad_qg_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_15000_ruquad_qg_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_15000_ruquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|252.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-15000-ruquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_15000_ruquad_qg_ru.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_15000_ruquad_qg_ru.md new file mode 100644 index 00000000000000..2cb9a07da13965 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_15000_ruquad_qg_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_15000_ruquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_15000_ruquad_qg +date: 2024-08-22 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_15000_ruquad_qg` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_15000_ruquad_qg_ru_5.4.2_3.0_1724313612428.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_15000_ruquad_qg_ru_5.4.2_3.0_1724313612428.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_15000_ruquad_qg","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_15000_ruquad_qg", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_15000_ruquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|252.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-15000-ruquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_90000_ruquad_qg_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_90000_ruquad_qg_pipeline_ru.md new file mode 100644 index 00000000000000..49f93b2a481791 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_90000_ruquad_qg_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_90000_ruquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_90000_ruquad_qg_pipeline +date: 2024-08-22 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_90000_ruquad_qg_pipeline` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_90000_ruquad_qg_pipeline_ru_5.4.2_3.0_1724340552938.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_90000_ruquad_qg_pipeline_ru_5.4.2_3.0_1724340552938.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_90000_ruquad_qg_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_90000_ruquad_qg_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_90000_ruquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|592.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-90000-ruquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_90000_ruquad_qg_ru.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_90000_ruquad_qg_ru.md new file mode 100644 index 00000000000000..6ec5689d05e793 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_90000_ruquad_qg_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_90000_ruquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_90000_ruquad_qg +date: 2024-08-22 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_90000_ruquad_qg` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_90000_ruquad_qg_ru_5.4.2_3.0_1724340518242.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_90000_ruquad_qg_ru_5.4.2_3.0_1724340518242.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_90000_ruquad_qg","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_90000_ruquad_qg", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_90000_ruquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|592.8 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-90000-ruquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_ruquad_qa_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_ruquad_qa_pipeline_ru.md new file mode 100644 index 00000000000000..1540dee4b20c91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_ruquad_qa_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_ruquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_ruquad_qa_pipeline +date: 2024-08-22 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_ruquad_qa_pipeline` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_ruquad_qa_pipeline_ru_5.4.2_3.0_1724291383273.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_ruquad_qa_pipeline_ru_5.4.2_3.0_1724291383273.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_ruquad_qa_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_ruquad_qa_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_ruquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|826.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-ruquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_ruquad_qa_ru.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_ruquad_qa_ru.md new file mode 100644 index 00000000000000..072ed9b916112b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_russian_ruquad_qa_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_ruquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_ruquad_qa +date: 2024-08-22 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_ruquad_qa` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_ruquad_qa_ru_5.4.2_3.0_1724291325980.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_ruquad_qa_ru_5.4.2_3.0_1724291325980.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_ruquad_qa","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_ruquad_qa", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_ruquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|826.2 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-ruquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_60000_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_60000_en.md new file mode 100644 index 00000000000000..ebe229db531364 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_spanish_60000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_60000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_60000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_60000_en_5.4.2_3.0_1724302938138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_60000_en_5.4.2_3.0_1724302938138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|262.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_60000_pipeline_en.md new file mode 100644 index 00000000000000..fae7d3a7e7a3fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_spanish_60000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_60000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_60000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_60000_pipeline_en_5.4.2_3.0_1724303028476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_60000_pipeline_en_5.4.2_3.0_1724303028476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_spanish_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_spanish_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|262.7 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_esquad_qa_es.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_esquad_qa_es.md new file mode 100644 index 00000000000000..b3a5be19ba307b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_esquad_qa_es.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_esquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_esquad_qa +date: 2024-08-22 +tags: [es, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_esquad_qa` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_esquad_qa_es_5.4.2_3.0_1724294549043.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_esquad_qa_es_5.4.2_3.0_1724294549043.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_esquad_qa","es") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_spanish_esquad_qa", "es") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_esquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|es| +|Size:|788.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-esquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_esquad_qa_pipeline_es.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_esquad_qa_pipeline_es.md new file mode 100644 index 00000000000000..952bc4704c8aa1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_small_trimmed_spanish_esquad_qa_pipeline_es.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Castilian, Spanish mt5_small_trimmed_spanish_esquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_spanish_esquad_qa_pipeline +date: 2024-08-22 +tags: [es, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: es +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_spanish_esquad_qa_pipeline` is a Castilian, Spanish model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_esquad_qa_pipeline_es_5.4.2_3.0_1724294600432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_spanish_esquad_qa_pipeline_es_5.4.2_3.0_1724294600432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_spanish_esquad_qa_pipeline", lang = "es") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_spanish_esquad_qa_pipeline", lang = "es") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_spanish_esquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|es| +|Size:|788.0 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-esquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_summarizer_persian_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_summarizer_persian_en.md new file mode 100644 index 00000000000000..1dd946f1b2e5e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_summarizer_persian_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_summarizer_persian T5Transformer from sarrkar +author: John Snow Labs +name: mt5_summarizer_persian +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarizer_persian` is a English model originally trained by sarrkar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarizer_persian_en_5.4.2_3.0_1724357675657.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarizer_persian_en_5.4.2_3.0_1724357675657.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_summarizer_persian","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_summarizer_persian", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarizer_persian| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sarrkar/mt5-summarizer-persian \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5_summarizer_persian_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5_summarizer_persian_pipeline_en.md new file mode 100644 index 00000000000000..7a8c83a534c9e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5_summarizer_persian_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_summarizer_persian_pipeline pipeline T5Transformer from sarrkar +author: John Snow Labs +name: mt5_summarizer_persian_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarizer_persian_pipeline` is a English model originally trained by sarrkar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarizer_persian_pipeline_en_5.4.2_3.0_1724357790771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarizer_persian_pipeline_en_5.4.2_3.0_1724357790771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_summarizer_persian_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_summarizer_persian_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarizer_persian_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/sarrkar/mt5-summarizer-persian + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5meu_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5meu_en.md new file mode 100644 index 00000000000000..5398f5b4b18f55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5meu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5meu T5Transformer from mateiaassAI +author: John Snow Labs +name: mt5meu +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5meu` is a English model originally trained by mateiaassAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5meu_en_5.4.2_3.0_1724353795484.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5meu_en_5.4.2_3.0_1724353795484.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5meu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5meu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5meu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.6 GB| + +## References + +https://huggingface.co/mateiaassAI/mt5meu \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5meu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5meu_pipeline_en.md new file mode 100644 index 00000000000000..82b27151190b3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5meu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5meu_pipeline pipeline T5Transformer from mateiaassAI +author: John Snow Labs +name: mt5meu_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5meu_pipeline` is a English model originally trained by mateiaassAI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5meu_pipeline_en_5.4.2_3.0_1724353929291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5meu_pipeline_en_5.4.2_3.0_1724353929291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5meu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5meu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5meu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.6 GB| + +## References + +https://huggingface.co/mateiaassAI/mt5meu + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5small_ruparaphraser_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5small_ruparaphraser_en.md new file mode 100644 index 00000000000000..0c15123e576527 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5small_ruparaphraser_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5small_ruparaphraser T5Transformer from alenusch +author: John Snow Labs +name: mt5small_ruparaphraser +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5small_ruparaphraser` is a English model originally trained by alenusch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5small_ruparaphraser_en_5.4.2_3.0_1724286994408.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5small_ruparaphraser_en_5.4.2_3.0_1724286994408.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5small_ruparaphraser","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5small_ruparaphraser", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5small_ruparaphraser| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/alenusch/mt5small-ruparaphraser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mt5small_ruparaphraser_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-mt5small_ruparaphraser_pipeline_en.md new file mode 100644 index 00000000000000..3135086fb4fb8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mt5small_ruparaphraser_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5small_ruparaphraser_pipeline pipeline T5Transformer from alenusch +author: John Snow Labs +name: mt5small_ruparaphraser_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5small_ruparaphraser_pipeline` is a English model originally trained by alenusch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5small_ruparaphraser_pipeline_en_5.4.2_3.0_1724287174130.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5small_ruparaphraser_pipeline_en_5.4.2_3.0_1724287174130.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5small_ruparaphraser_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5small_ruparaphraser_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5small_ruparaphraser_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/alenusch/mt5small-ruparaphraser + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-multi_news_train_4000_t5_small_summary_model_en.md b/docs/_posts/ahmedlone127/2024-08-22-multi_news_train_4000_t5_small_summary_model_en.md new file mode 100644 index 00000000000000..b5b984c8283480 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-multi_news_train_4000_t5_small_summary_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English multi_news_train_4000_t5_small_summary_model T5Transformer from AlexandraSnelling +author: John Snow Labs +name: multi_news_train_4000_t5_small_summary_model +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multi_news_train_4000_t5_small_summary_model` is a English model originally trained by AlexandraSnelling. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multi_news_train_4000_t5_small_summary_model_en_5.4.2_3.0_1724340730771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multi_news_train_4000_t5_small_summary_model_en_5.4.2_3.0_1724340730771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("multi_news_train_4000_t5_small_summary_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("multi_news_train_4000_t5_small_summary_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multi_news_train_4000_t5_small_summary_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.0 MB| + +## References + +https://huggingface.co/AlexandraSnelling/multi_news_train_4000_t5-small_summary_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-multi_news_train_4000_t5_small_summary_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-multi_news_train_4000_t5_small_summary_model_pipeline_en.md new file mode 100644 index 00000000000000..9f1d13b3e97290 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-multi_news_train_4000_t5_small_summary_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English multi_news_train_4000_t5_small_summary_model_pipeline pipeline T5Transformer from AlexandraSnelling +author: John Snow Labs +name: multi_news_train_4000_t5_small_summary_model_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multi_news_train_4000_t5_small_summary_model_pipeline` is a English model originally trained by AlexandraSnelling. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multi_news_train_4000_t5_small_summary_model_pipeline_en_5.4.2_3.0_1724340750315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multi_news_train_4000_t5_small_summary_model_pipeline_en_5.4.2_3.0_1724340750315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("multi_news_train_4000_t5_small_summary_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("multi_news_train_4000_t5_small_summary_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multi_news_train_4000_t5_small_summary_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.0 MB| + +## References + +https://huggingface.co/AlexandraSnelling/multi_news_train_4000_t5-small_summary_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-mymodel_louis4397_en.md b/docs/_posts/ahmedlone127/2024-08-22-mymodel_louis4397_en.md new file mode 100644 index 00000000000000..66b434c4d769bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-mymodel_louis4397_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mymodel_louis4397 T5Transformer from Louis4397 +author: John Snow Labs +name: mymodel_louis4397 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mymodel_louis4397` is a English model originally trained by Louis4397. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mymodel_louis4397_en_5.4.2_3.0_1724339824403.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mymodel_louis4397_en_5.4.2_3.0_1724339824403.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mymodel_louis4397","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mymodel_louis4397", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mymodel_louis4397| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/Louis4397/mymodel \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-name_tonga_tonga_islands_hex_en.md b/docs/_posts/ahmedlone127/2024-08-22-name_tonga_tonga_islands_hex_en.md new file mode 100644 index 00000000000000..6edbb6981bc32f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-name_tonga_tonga_islands_hex_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English name_tonga_tonga_islands_hex T5Transformer from oddadmix +author: John Snow Labs +name: name_tonga_tonga_islands_hex +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`name_tonga_tonga_islands_hex` is a English model originally trained by oddadmix. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/name_tonga_tonga_islands_hex_en_5.4.2_3.0_1724293819757.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/name_tonga_tonga_islands_hex_en_5.4.2_3.0_1724293819757.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("name_tonga_tonga_islands_hex","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("name_tonga_tonga_islands_hex", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|name_tonga_tonga_islands_hex| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.5 MB| + +## References + +https://huggingface.co/oddadmix/name-to-hex \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-name_tonga_tonga_islands_hex_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-name_tonga_tonga_islands_hex_pipeline_en.md new file mode 100644 index 00000000000000..8750282acdb213 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-name_tonga_tonga_islands_hex_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English name_tonga_tonga_islands_hex_pipeline pipeline T5Transformer from oddadmix +author: John Snow Labs +name: name_tonga_tonga_islands_hex_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`name_tonga_tonga_islands_hex_pipeline` is a English model originally trained by oddadmix. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/name_tonga_tonga_islands_hex_pipeline_en_5.4.2_3.0_1724293839770.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/name_tonga_tonga_islands_hex_pipeline_en_5.4.2_3.0_1724293839770.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("name_tonga_tonga_islands_hex_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("name_tonga_tonga_islands_hex_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|name_tonga_tonga_islands_hex_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.5 MB| + +## References + +https://huggingface.co/oddadmix/name-to-hex + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-nepal_bhasa_summary_model_en.md b/docs/_posts/ahmedlone127/2024-08-22-nepal_bhasa_summary_model_en.md new file mode 100644 index 00000000000000..481b8edcfa116b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-nepal_bhasa_summary_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nepal_bhasa_summary_model T5Transformer from karthiksab +author: John Snow Labs +name: nepal_bhasa_summary_model +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nepal_bhasa_summary_model` is a English model originally trained by karthiksab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nepal_bhasa_summary_model_en_5.4.2_3.0_1724327662893.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nepal_bhasa_summary_model_en_5.4.2_3.0_1724327662893.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nepal_bhasa_summary_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nepal_bhasa_summary_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nepal_bhasa_summary_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.8 MB| + +## References + +https://huggingface.co/karthiksab/new_summary_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-nepal_bhasa_summary_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-nepal_bhasa_summary_model_pipeline_en.md new file mode 100644 index 00000000000000..1cad52a489479a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-nepal_bhasa_summary_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nepal_bhasa_summary_model_pipeline pipeline T5Transformer from karthiksab +author: John Snow Labs +name: nepal_bhasa_summary_model_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nepal_bhasa_summary_model_pipeline` is a English model originally trained by karthiksab. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nepal_bhasa_summary_model_pipeline_en_5.4.2_3.0_1724327682843.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nepal_bhasa_summary_model_pipeline_en_5.4.2_3.0_1724327682843.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nepal_bhasa_summary_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nepal_bhasa_summary_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nepal_bhasa_summary_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.8 MB| + +## References + +https://huggingface.co/karthiksab/new_summary_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-news_article_title_gen_en.md b/docs/_posts/ahmedlone127/2024-08-22-news_article_title_gen_en.md new file mode 100644 index 00000000000000..bc9416ab467275 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-news_article_title_gen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English news_article_title_gen T5Transformer from hyutake +author: John Snow Labs +name: news_article_title_gen +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`news_article_title_gen` is a English model originally trained by hyutake. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/news_article_title_gen_en_5.4.2_3.0_1724308327375.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/news_article_title_gen_en_5.4.2_3.0_1724308327375.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("news_article_title_gen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("news_article_title_gen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|news_article_title_gen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hyutake/news-article-title-gen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-news_article_title_gen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-news_article_title_gen_pipeline_en.md new file mode 100644 index 00000000000000..622b5d6049c6ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-news_article_title_gen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English news_article_title_gen_pipeline pipeline T5Transformer from hyutake +author: John Snow Labs +name: news_article_title_gen_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`news_article_title_gen_pipeline` is a English model originally trained by hyutake. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/news_article_title_gen_pipeline_en_5.4.2_3.0_1724308376992.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/news_article_title_gen_pipeline_en_5.4.2_3.0_1724308376992.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("news_article_title_gen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("news_article_title_gen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|news_article_title_gen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/hyutake/news-article-title-gen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-22-normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_en.md new file mode 100644 index 00000000000000..bf530847f738e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_with_edge_document_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_with_edge_document_level_t5_run3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_with_edge_document_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_en_5.4.2_3.0_1724352458534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_en_5.4.2_3.0_1724352458534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_with_edge_document_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_nodes_augmented_graphs_with_edge_document_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_with_edge_document_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|313.2 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_with_edge_document_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..a16fbda1b40551 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724352476842.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724352476842.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_augmented_graphs_with_edge_document_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|313.2 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_augmented_graphs_with_edge_document_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-normal_order_nodes_with_edge_label_sentence_level_t5_en.md b/docs/_posts/ahmedlone127/2024-08-22-normal_order_nodes_with_edge_label_sentence_level_t5_en.md new file mode 100644 index 00000000000000..3a6d107bcab6b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-normal_order_nodes_with_edge_label_sentence_level_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_order_nodes_with_edge_label_sentence_level_t5 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_order_nodes_with_edge_label_sentence_level_t5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_order_nodes_with_edge_label_sentence_level_t5` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_order_nodes_with_edge_label_sentence_level_t5_en_5.4.2_3.0_1724298362815.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_order_nodes_with_edge_label_sentence_level_t5_en_5.4.2_3.0_1724298362815.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_order_nodes_with_edge_label_sentence_level_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_order_nodes_with_edge_label_sentence_level_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_order_nodes_with_edge_label_sentence_level_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.0 MB| + +## References + +https://huggingface.co/sheoran95/normal_order_nodes_with_edge_label_sentence_level_T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-normal_order_nodes_with_edge_label_sentence_level_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-normal_order_nodes_with_edge_label_sentence_level_t5_pipeline_en.md new file mode 100644 index 00000000000000..7278631e7df440 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-normal_order_nodes_with_edge_label_sentence_level_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_order_nodes_with_edge_label_sentence_level_t5_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_order_nodes_with_edge_label_sentence_level_t5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_order_nodes_with_edge_label_sentence_level_t5_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_order_nodes_with_edge_label_sentence_level_t5_pipeline_en_5.4.2_3.0_1724298381709.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_order_nodes_with_edge_label_sentence_level_t5_pipeline_en_5.4.2_3.0_1724298381709.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_order_nodes_with_edge_label_sentence_level_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_order_nodes_with_edge_label_sentence_level_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_order_nodes_with_edge_label_sentence_level_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.0 MB| + +## References + +https://huggingface.co/sheoran95/normal_order_nodes_with_edge_label_sentence_level_T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_en.md b/docs/_posts/ahmedlone127/2024-08-22-norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_en.md new file mode 100644 index 00000000000000..76fdc10ab0c5be --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5 T5Transformer from tevosianv +author: John Snow Labs +name: norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5` is a English model originally trained by tevosianv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_en_5.4.2_3.0_1724363061152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_en_5.4.2_3.0_1724363061152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/tevosianv/nb-mt5-base-finetuned-no-email-summary-no_t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline_en.md new file mode 100644 index 00000000000000..a8085a054e30e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline pipeline T5Transformer from tevosianv +author: John Snow Labs +name: norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline` is a English model originally trained by tevosianv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline_en_5.4.2_3.0_1724363190133.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline_en_5.4.2_3.0_1724363190133.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|norwegian_bokml_mt5_base_finetuned_norwegian_email_summary_norwegian_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/tevosianv/nb-mt5-base-finetuned-no-email-summary-no_t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-output_dir_mayankmoon_en.md b/docs/_posts/ahmedlone127/2024-08-22-output_dir_mayankmoon_en.md new file mode 100644 index 00000000000000..2f810d44effa16 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-output_dir_mayankmoon_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English output_dir_mayankmoon T5Transformer from MayankMoon +author: John Snow Labs +name: output_dir_mayankmoon +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`output_dir_mayankmoon` is a English model originally trained by MayankMoon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/output_dir_mayankmoon_en_5.4.2_3.0_1724360153788.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/output_dir_mayankmoon_en_5.4.2_3.0_1724360153788.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("output_dir_mayankmoon","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("output_dir_mayankmoon", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|output_dir_mayankmoon| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|331.3 MB| + +## References + +https://huggingface.co/MayankMoon/output_dir \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-output_dir_mayankmoon_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-output_dir_mayankmoon_pipeline_en.md new file mode 100644 index 00000000000000..d1ccbe3ee3d02e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-output_dir_mayankmoon_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English output_dir_mayankmoon_pipeline pipeline T5Transformer from MayankMoon +author: John Snow Labs +name: output_dir_mayankmoon_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`output_dir_mayankmoon_pipeline` is a English model originally trained by MayankMoon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/output_dir_mayankmoon_pipeline_en_5.4.2_3.0_1724360172894.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/output_dir_mayankmoon_pipeline_en_5.4.2_3.0_1724360172894.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("output_dir_mayankmoon_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("output_dir_mayankmoon_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|output_dir_mayankmoon_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|331.3 MB| + +## References + +https://huggingface.co/MayankMoon/output_dir + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-outputs_nishita_en.md b/docs/_posts/ahmedlone127/2024-08-22-outputs_nishita_en.md new file mode 100644 index 00000000000000..5f8251739a5e6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-outputs_nishita_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English outputs_nishita T5Transformer from nishita +author: John Snow Labs +name: outputs_nishita +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`outputs_nishita` is a English model originally trained by nishita. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/outputs_nishita_en_5.4.2_3.0_1724364703830.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/outputs_nishita_en_5.4.2_3.0_1724364703830.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("outputs_nishita","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("outputs_nishita", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|outputs_nishita| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|992.2 MB| + +## References + +https://huggingface.co/nishita/outputs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-outputs_nishita_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-outputs_nishita_pipeline_en.md new file mode 100644 index 00000000000000..02d9df97a83276 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-outputs_nishita_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English outputs_nishita_pipeline pipeline T5Transformer from nishita +author: John Snow Labs +name: outputs_nishita_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`outputs_nishita_pipeline` is a English model originally trained by nishita. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/outputs_nishita_pipeline_en_5.4.2_3.0_1724364753586.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/outputs_nishita_pipeline_en_5.4.2_3.0_1724364753586.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("outputs_nishita_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("outputs_nishita_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|outputs_nishita_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|992.2 MB| + +## References + +https://huggingface.co/nishita/outputs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-p5_toys_base_en.md b/docs/_posts/ahmedlone127/2024-08-22-p5_toys_base_en.md new file mode 100644 index 00000000000000..53924fbdf3d568 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-p5_toys_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English p5_toys_base T5Transformer from makitanikaze +author: John Snow Labs +name: p5_toys_base +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`p5_toys_base` is a English model originally trained by makitanikaze. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/p5_toys_base_en_5.4.2_3.0_1724365467093.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/p5_toys_base_en_5.4.2_3.0_1724365467093.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("p5_toys_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("p5_toys_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|p5_toys_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/makitanikaze/P5_toys_base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-p5_toys_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-p5_toys_base_pipeline_en.md new file mode 100644 index 00000000000000..8873feb5549e31 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-p5_toys_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English p5_toys_base_pipeline pipeline T5Transformer from makitanikaze +author: John Snow Labs +name: p5_toys_base_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`p5_toys_base_pipeline` is a English model originally trained by makitanikaze. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/p5_toys_base_pipeline_en_5.4.2_3.0_1724365513892.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/p5_toys_base_pipeline_en_5.4.2_3.0_1724365513892.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("p5_toys_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("p5_toys_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|p5_toys_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/makitanikaze/P5_toys_base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-polish_transliterator_en.md b/docs/_posts/ahmedlone127/2024-08-22-polish_transliterator_en.md new file mode 100644 index 00000000000000..a8aa9a79e6aeda --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-polish_transliterator_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English polish_transliterator T5Transformer from marcus2000 +author: John Snow Labs +name: polish_transliterator +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polish_transliterator` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polish_transliterator_en_5.4.2_3.0_1724353621258.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polish_transliterator_en_5.4.2_3.0_1724353621258.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("polish_transliterator","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("polish_transliterator", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polish_transliterator| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|963.1 MB| + +## References + +https://huggingface.co/marcus2000/polish_transliterator \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-polish_transliterator_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-polish_transliterator_pipeline_en.md new file mode 100644 index 00000000000000..bf8b5bbc0ae630 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-polish_transliterator_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English polish_transliterator_pipeline pipeline T5Transformer from marcus2000 +author: John Snow Labs +name: polish_transliterator_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`polish_transliterator_pipeline` is a English model originally trained by marcus2000. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/polish_transliterator_pipeline_en_5.4.2_3.0_1724353672297.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/polish_transliterator_pipeline_en_5.4.2_3.0_1724353672297.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("polish_transliterator_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("polish_transliterator_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|polish_transliterator_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|963.2 MB| + +## References + +https://huggingface.co/marcus2000/polish_transliterator + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-pubmedul2_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-pubmedul2_small_en.md new file mode 100644 index 00000000000000..7ace1e2dd1947e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-pubmedul2_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pubmedul2_small T5Transformer from Siddharth63 +author: John Snow Labs +name: pubmedul2_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pubmedul2_small` is a English model originally trained by Siddharth63. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pubmedul2_small_en_5.4.2_3.0_1724328526990.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pubmedul2_small_en_5.4.2_3.0_1724328526990.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pubmedul2_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pubmedul2_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pubmedul2_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/Siddharth63/pubmedul2_small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-pubmedul2_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-pubmedul2_small_pipeline_en.md new file mode 100644 index 00000000000000..37ad02c63f6af1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-pubmedul2_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pubmedul2_small_pipeline pipeline T5Transformer from Siddharth63 +author: John Snow Labs +name: pubmedul2_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pubmedul2_small_pipeline` is a English model originally trained by Siddharth63. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pubmedul2_small_pipeline_en_5.4.2_3.0_1724328543700.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pubmedul2_small_pipeline_en_5.4.2_3.0_1724328543700.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pubmedul2_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pubmedul2_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pubmedul2_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/Siddharth63/pubmedul2_small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-q3_results_en.md b/docs/_posts/ahmedlone127/2024-08-22-q3_results_en.md new file mode 100644 index 00000000000000..698f3ec96608fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-q3_results_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English q3_results T5Transformer from siyagarg12 +author: John Snow Labs +name: q3_results +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`q3_results` is a English model originally trained by siyagarg12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/q3_results_en_5.4.2_3.0_1724356842494.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/q3_results_en_5.4.2_3.0_1724356842494.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("q3_results","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("q3_results", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|q3_results| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.6 MB| + +## References + +https://huggingface.co/siyagarg12/q3_results \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-q3_results_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-q3_results_pipeline_en.md new file mode 100644 index 00000000000000..c37859fd8f8039 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-q3_results_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English q3_results_pipeline pipeline T5Transformer from siyagarg12 +author: John Snow Labs +name: q3_results_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`q3_results_pipeline` is a English model originally trained by siyagarg12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/q3_results_pipeline_en_5.4.2_3.0_1724356862499.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/q3_results_pipeline_en_5.4.2_3.0_1724356862499.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("q3_results_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("q3_results_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|q3_results_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.6 MB| + +## References + +https://huggingface.co/siyagarg12/q3_results + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-qa_indo_math_k_en.md b/docs/_posts/ahmedlone127/2024-08-22-qa_indo_math_k_en.md new file mode 100644 index 00000000000000..ac793709c5a2c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-qa_indo_math_k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qa_indo_math_k T5Transformer from fadhilarkan +author: John Snow Labs +name: qa_indo_math_k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qa_indo_math_k` is a English model originally trained by fadhilarkan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qa_indo_math_k_en_5.4.2_3.0_1724292276585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qa_indo_math_k_en_5.4.2_3.0_1724292276585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qa_indo_math_k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qa_indo_math_k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qa_indo_math_k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/fadhilarkan/qa-indo-math-k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-qa_indo_math_k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-qa_indo_math_k_pipeline_en.md new file mode 100644 index 00000000000000..0564df303afa8c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-qa_indo_math_k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qa_indo_math_k_pipeline pipeline T5Transformer from fadhilarkan +author: John Snow Labs +name: qa_indo_math_k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qa_indo_math_k_pipeline` is a English model originally trained by fadhilarkan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qa_indo_math_k_pipeline_en_5.4.2_3.0_1724292293410.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qa_indo_math_k_pipeline_en_5.4.2_3.0_1724292293410.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qa_indo_math_k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qa_indo_math_k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qa_indo_math_k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/fadhilarkan/qa-indo-math-k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-qcpg_mscoco_sbert_lr1e_4_en.md b/docs/_posts/ahmedlone127/2024-08-22-qcpg_mscoco_sbert_lr1e_4_en.md new file mode 100644 index 00000000000000..fd024cc17474f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-qcpg_mscoco_sbert_lr1e_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qcpg_mscoco_sbert_lr1e_4 T5Transformer from madhavsankar +author: John Snow Labs +name: qcpg_mscoco_sbert_lr1e_4 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qcpg_mscoco_sbert_lr1e_4` is a English model originally trained by madhavsankar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qcpg_mscoco_sbert_lr1e_4_en_5.4.2_3.0_1724346316970.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qcpg_mscoco_sbert_lr1e_4_en_5.4.2_3.0_1724346316970.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qcpg_mscoco_sbert_lr1e_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qcpg_mscoco_sbert_lr1e_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qcpg_mscoco_sbert_lr1e_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/madhavsankar/qcpg-mscoco-sbert-lr1e-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-qcpg_mscoco_sbert_lr1e_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-qcpg_mscoco_sbert_lr1e_4_pipeline_en.md new file mode 100644 index 00000000000000..401f7867bcb6a7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-qcpg_mscoco_sbert_lr1e_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qcpg_mscoco_sbert_lr1e_4_pipeline pipeline T5Transformer from madhavsankar +author: John Snow Labs +name: qcpg_mscoco_sbert_lr1e_4_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qcpg_mscoco_sbert_lr1e_4_pipeline` is a English model originally trained by madhavsankar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qcpg_mscoco_sbert_lr1e_4_pipeline_en_5.4.2_3.0_1724346365379.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qcpg_mscoco_sbert_lr1e_4_pipeline_en_5.4.2_3.0_1724346365379.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qcpg_mscoco_sbert_lr1e_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qcpg_mscoco_sbert_lr1e_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qcpg_mscoco_sbert_lr1e_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/madhavsankar/qcpg-mscoco-sbert-lr1e-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-qqp_t5_large_seed_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-qqp_t5_large_seed_1_en.md new file mode 100644 index 00000000000000..21fd5e1db861c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-qqp_t5_large_seed_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qqp_t5_large_seed_1 T5Transformer from utahnlp +author: John Snow Labs +name: qqp_t5_large_seed_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qqp_t5_large_seed_1` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qqp_t5_large_seed_1_en_5.4.2_3.0_1724327854599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qqp_t5_large_seed_1_en_5.4.2_3.0_1724327854599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qqp_t5_large_seed_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qqp_t5_large_seed_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qqp_t5_large_seed_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/qqp_t5-large_seed-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-qqp_t5_large_seed_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-qqp_t5_large_seed_1_pipeline_en.md new file mode 100644 index 00000000000000..315f7a0ffa8f04 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-qqp_t5_large_seed_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qqp_t5_large_seed_1_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: qqp_t5_large_seed_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qqp_t5_large_seed_1_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qqp_t5_large_seed_1_pipeline_en_5.4.2_3.0_1724328023494.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qqp_t5_large_seed_1_pipeline_en_5.4.2_3.0_1724328023494.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qqp_t5_large_seed_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qqp_t5_large_seed_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qqp_t5_large_seed_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/utahnlp/qqp_t5-large_seed-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-query_builder_en.md b/docs/_posts/ahmedlone127/2024-08-22-query_builder_en.md new file mode 100644 index 00000000000000..1333676adaec93 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-query_builder_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English query_builder T5Transformer from Suva +author: John Snow Labs +name: query_builder +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`query_builder` is a English model originally trained by Suva. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/query_builder_en_5.4.2_3.0_1724345166358.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/query_builder_en_5.4.2_3.0_1724345166358.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("query_builder","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("query_builder", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|query_builder| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.4 MB| + +## References + +https://huggingface.co/Suva/query_builder \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-query_builder_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-query_builder_pipeline_en.md new file mode 100644 index 00000000000000..73e6239c894c32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-query_builder_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English query_builder_pipeline pipeline T5Transformer from Suva +author: John Snow Labs +name: query_builder_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`query_builder_pipeline` is a English model originally trained by Suva. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/query_builder_pipeline_en_5.4.2_3.0_1724345184050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/query_builder_pipeline_en_5.4.2_3.0_1724345184050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("query_builder_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("query_builder_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|query_builder_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.4 MB| + +## References + +https://huggingface.co/Suva/query_builder + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-quizbot_ai_base_en.md b/docs/_posts/ahmedlone127/2024-08-22-quizbot_ai_base_en.md new file mode 100644 index 00000000000000..0b43428f607be6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-quizbot_ai_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English quizbot_ai_base T5Transformer from Sujithanumala +author: John Snow Labs +name: quizbot_ai_base +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`quizbot_ai_base` is a English model originally trained by Sujithanumala. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/quizbot_ai_base_en_5.4.2_3.0_1724305142674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/quizbot_ai_base_en_5.4.2_3.0_1724305142674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("quizbot_ai_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("quizbot_ai_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|quizbot_ai_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/Sujithanumala/QuizBot.AI-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-quizbot_ai_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-quizbot_ai_base_pipeline_en.md new file mode 100644 index 00000000000000..5946fe4389c970 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-quizbot_ai_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English quizbot_ai_base_pipeline pipeline T5Transformer from Sujithanumala +author: John Snow Labs +name: quizbot_ai_base_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`quizbot_ai_base_pipeline` is a English model originally trained by Sujithanumala. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/quizbot_ai_base_pipeline_en_5.4.2_3.0_1724305159528.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/quizbot_ai_base_pipeline_en_5.4.2_3.0_1724305159528.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("quizbot_ai_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("quizbot_ai_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|quizbot_ai_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/Sujithanumala/QuizBot.AI-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-reddit_post_flant5_en.md b/docs/_posts/ahmedlone127/2024-08-22-reddit_post_flant5_en.md new file mode 100644 index 00000000000000..571103bfa1bfbb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-reddit_post_flant5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English reddit_post_flant5 T5Transformer from tatai08 +author: John Snow Labs +name: reddit_post_flant5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`reddit_post_flant5` is a English model originally trained by tatai08. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/reddit_post_flant5_en_5.4.2_3.0_1724298561102.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/reddit_post_flant5_en_5.4.2_3.0_1724298561102.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("reddit_post_flant5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("reddit_post_flant5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|reddit_post_flant5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tatai08/reddit-post-flant5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-reddit_post_flant5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-reddit_post_flant5_pipeline_en.md new file mode 100644 index 00000000000000..bf0315032791ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-reddit_post_flant5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English reddit_post_flant5_pipeline pipeline T5Transformer from tatai08 +author: John Snow Labs +name: reddit_post_flant5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`reddit_post_flant5_pipeline` is a English model originally trained by tatai08. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/reddit_post_flant5_pipeline_en_5.4.2_3.0_1724298608222.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/reddit_post_flant5_pipeline_en_5.4.2_3.0_1724298608222.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("reddit_post_flant5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("reddit_post_flant5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|reddit_post_flant5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tatai08/reddit-post-flant5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_m2_en.md b/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_m2_en.md new file mode 100644 index 00000000000000..40ed55da8c5861 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_m2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English results_mt5_finetuned_squad_accelerate_m2 T5Transformer from YuTingHu +author: John Snow Labs +name: results_mt5_finetuned_squad_accelerate_m2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_mt5_finetuned_squad_accelerate_m2` is a English model originally trained by YuTingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_mt5_finetuned_squad_accelerate_m2_en_5.4.2_3.0_1724328627345.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_mt5_finetuned_squad_accelerate_m2_en_5.4.2_3.0_1724328627345.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("results_mt5_finetuned_squad_accelerate_m2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("results_mt5_finetuned_squad_accelerate_m2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_mt5_finetuned_squad_accelerate_m2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/YuTingHu/results-mt5-finetuned-squad-accelerate_M2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_m2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_m2_pipeline_en.md new file mode 100644 index 00000000000000..398c37eb49f76b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_m2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English results_mt5_finetuned_squad_accelerate_m2_pipeline pipeline T5Transformer from YuTingHu +author: John Snow Labs +name: results_mt5_finetuned_squad_accelerate_m2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_mt5_finetuned_squad_accelerate_m2_pipeline` is a English model originally trained by YuTingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_mt5_finetuned_squad_accelerate_m2_pipeline_en_5.4.2_3.0_1724328791656.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_mt5_finetuned_squad_accelerate_m2_pipeline_en_5.4.2_3.0_1724328791656.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("results_mt5_finetuned_squad_accelerate_m2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("results_mt5_finetuned_squad_accelerate_m2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_mt5_finetuned_squad_accelerate_m2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/YuTingHu/results-mt5-finetuned-squad-accelerate_M2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_yutinghu_en.md b/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_yutinghu_en.md new file mode 100644 index 00000000000000..a923f0b33e90a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_yutinghu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English results_mt5_finetuned_squad_accelerate_yutinghu T5Transformer from YuTingHu +author: John Snow Labs +name: results_mt5_finetuned_squad_accelerate_yutinghu +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_mt5_finetuned_squad_accelerate_yutinghu` is a English model originally trained by YuTingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_mt5_finetuned_squad_accelerate_yutinghu_en_5.4.2_3.0_1724313025362.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_mt5_finetuned_squad_accelerate_yutinghu_en_5.4.2_3.0_1724313025362.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("results_mt5_finetuned_squad_accelerate_yutinghu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("results_mt5_finetuned_squad_accelerate_yutinghu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_mt5_finetuned_squad_accelerate_yutinghu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/YuTingHu/results-mt5-finetuned-squad-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_yutinghu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_yutinghu_pipeline_en.md new file mode 100644 index 00000000000000..4292a4f313e647 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-results_mt5_finetuned_squad_accelerate_yutinghu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English results_mt5_finetuned_squad_accelerate_yutinghu_pipeline pipeline T5Transformer from YuTingHu +author: John Snow Labs +name: results_mt5_finetuned_squad_accelerate_yutinghu_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_mt5_finetuned_squad_accelerate_yutinghu_pipeline` is a English model originally trained by YuTingHu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_mt5_finetuned_squad_accelerate_yutinghu_pipeline_en_5.4.2_3.0_1724313182237.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_mt5_finetuned_squad_accelerate_yutinghu_pipeline_en_5.4.2_3.0_1724313182237.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("results_mt5_finetuned_squad_accelerate_yutinghu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("results_mt5_finetuned_squad_accelerate_yutinghu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_mt5_finetuned_squad_accelerate_yutinghu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/YuTingHu/results-mt5-finetuned-squad-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-results_saijahnavibachu_en.md b/docs/_posts/ahmedlone127/2024-08-22-results_saijahnavibachu_en.md new file mode 100644 index 00000000000000..c189f35c50ea95 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-results_saijahnavibachu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English results_saijahnavibachu T5Transformer from saijahnavibachu +author: John Snow Labs +name: results_saijahnavibachu +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_saijahnavibachu` is a English model originally trained by saijahnavibachu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_saijahnavibachu_en_5.4.2_3.0_1724361265467.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_saijahnavibachu_en_5.4.2_3.0_1724361265467.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("results_saijahnavibachu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("results_saijahnavibachu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_saijahnavibachu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|285.3 MB| + +## References + +https://huggingface.co/saijahnavibachu/results \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-results_saijahnavibachu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-results_saijahnavibachu_pipeline_en.md new file mode 100644 index 00000000000000..82d99e16a5ab99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-results_saijahnavibachu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English results_saijahnavibachu_pipeline pipeline T5Transformer from saijahnavibachu +author: John Snow Labs +name: results_saijahnavibachu_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`results_saijahnavibachu_pipeline` is a English model originally trained by saijahnavibachu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/results_saijahnavibachu_pipeline_en_5.4.2_3.0_1724361291554.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/results_saijahnavibachu_pipeline_en_5.4.2_3.0_1724361291554.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("results_saijahnavibachu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("results_saijahnavibachu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|results_saijahnavibachu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|285.3 MB| + +## References + +https://huggingface.co/saijahnavibachu/results + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-roberta_multiwoz21_sys_en.md b/docs/_posts/ahmedlone127/2024-08-22-roberta_multiwoz21_sys_en.md new file mode 100644 index 00000000000000..753d4dde8d9dc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-roberta_multiwoz21_sys_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English roberta_multiwoz21_sys T5Transformer from julek37 +author: John Snow Labs +name: roberta_multiwoz21_sys +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`roberta_multiwoz21_sys` is a English model originally trained by julek37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/roberta_multiwoz21_sys_en_5.4.2_3.0_1724318679062.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/roberta_multiwoz21_sys_en_5.4.2_3.0_1724318679062.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("roberta_multiwoz21_sys","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("roberta_multiwoz21_sys", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|roberta_multiwoz21_sys| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/julek37/Roberta-multiwoz21-sys \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-roberta_multiwoz21_sys_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-roberta_multiwoz21_sys_pipeline_en.md new file mode 100644 index 00000000000000..7053215b251f70 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-roberta_multiwoz21_sys_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English roberta_multiwoz21_sys_pipeline pipeline T5Transformer from julek37 +author: John Snow Labs +name: roberta_multiwoz21_sys_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`roberta_multiwoz21_sys_pipeline` is a English model originally trained by julek37. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/roberta_multiwoz21_sys_pipeline_en_5.4.2_3.0_1724318695431.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/roberta_multiwoz21_sys_pipeline_en_5.4.2_3.0_1724318695431.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("roberta_multiwoz21_sys_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("roberta_multiwoz21_sys_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|roberta_multiwoz21_sys_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/julek37/Roberta-multiwoz21-sys + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-rut5_base_pls_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-22-rut5_base_pls_pipeline_ru.md new file mode 100644 index 00000000000000..fa4df20eb82747 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-rut5_base_pls_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian rut5_base_pls_pipeline pipeline T5Transformer from r1char9 +author: John Snow Labs +name: rut5_base_pls_pipeline +date: 2024-08-22 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_pls_pipeline` is a Russian model originally trained by r1char9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_pls_pipeline_ru_5.4.2_3.0_1724301161320.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_pls_pipeline_ru_5.4.2_3.0_1724301161320.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_pls_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_pls_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_pls_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|1.0 GB| + +## References + +https://huggingface.co/r1char9/ruT5-base-pls + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-rut5_base_pls_ru.md b/docs/_posts/ahmedlone127/2024-08-22-rut5_base_pls_ru.md new file mode 100644 index 00000000000000..5970dbbfbad426 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-rut5_base_pls_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian rut5_base_pls T5Transformer from r1char9 +author: John Snow Labs +name: rut5_base_pls +date: 2024-08-22 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_pls` is a Russian model originally trained by r1char9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_pls_ru_5.4.2_3.0_1724301109711.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_pls_ru_5.4.2_3.0_1724301109711.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_pls","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_pls", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_pls| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|1.0 GB| + +## References + +https://huggingface.co/r1char9/ruT5-base-pls \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-rut5_base_simple_aphasia_lvl2_en.md b/docs/_posts/ahmedlone127/2024-08-22-rut5_base_simple_aphasia_lvl2_en.md new file mode 100644 index 00000000000000..76a0eabb38b7fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-rut5_base_simple_aphasia_lvl2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_simple_aphasia_lvl2 T5Transformer from ShinjuM +author: John Snow Labs +name: rut5_base_simple_aphasia_lvl2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_simple_aphasia_lvl2` is a English model originally trained by ShinjuM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_simple_aphasia_lvl2_en_5.4.2_3.0_1724353133023.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_simple_aphasia_lvl2_en_5.4.2_3.0_1724353133023.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_simple_aphasia_lvl2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_simple_aphasia_lvl2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_simple_aphasia_lvl2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.7 MB| + +## References + +https://huggingface.co/ShinjuM/rut5-base-simple-aphasia-lvl2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-rut5_base_simple_aphasia_lvl2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-rut5_base_simple_aphasia_lvl2_pipeline_en.md new file mode 100644 index 00000000000000..d2fe6a575fdcfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-rut5_base_simple_aphasia_lvl2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_simple_aphasia_lvl2_pipeline pipeline T5Transformer from ShinjuM +author: John Snow Labs +name: rut5_base_simple_aphasia_lvl2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_simple_aphasia_lvl2_pipeline` is a English model originally trained by ShinjuM. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_simple_aphasia_lvl2_pipeline_en_5.4.2_3.0_1724353182218.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_simple_aphasia_lvl2_pipeline_en_5.4.2_3.0_1724353182218.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_simple_aphasia_lvl2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_simple_aphasia_lvl2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_simple_aphasia_lvl2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.7 MB| + +## References + +https://huggingface.co/ShinjuM/rut5-base-simple-aphasia-lvl2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-rut5_large_pchelaeb_en.md b/docs/_posts/ahmedlone127/2024-08-22-rut5_large_pchelaeb_en.md new file mode 100644 index 00000000000000..364141b0f67815 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-rut5_large_pchelaeb_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_large_pchelaeb T5Transformer from pchelaEb +author: John Snow Labs +name: rut5_large_pchelaeb +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_large_pchelaeb` is a English model originally trained by pchelaEb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_large_pchelaeb_en_5.4.2_3.0_1724299632570.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_large_pchelaeb_en_5.4.2_3.0_1724299632570.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_large_pchelaeb","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_large_pchelaeb", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_large_pchelaeb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/pchelaEb/ruT5-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-rut5_large_pchelaeb_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-rut5_large_pchelaeb_pipeline_en.md new file mode 100644 index 00000000000000..3f5b4d921208bd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-rut5_large_pchelaeb_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_large_pchelaeb_pipeline pipeline T5Transformer from pchelaEb +author: John Snow Labs +name: rut5_large_pchelaeb_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_large_pchelaeb_pipeline` is a English model originally trained by pchelaEb. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_large_pchelaeb_pipeline_en_5.4.2_3.0_1724299810110.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_large_pchelaeb_pipeline_en_5.4.2_3.0_1724299810110.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_large_pchelaeb_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_large_pchelaeb_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_large_pchelaeb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/pchelaEb/ruT5-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-scifive_pubmedqa_question_generation_frozenwalker_en.md b/docs/_posts/ahmedlone127/2024-08-22-scifive_pubmedqa_question_generation_frozenwalker_en.md new file mode 100644 index 00000000000000..ab6139f50c0f6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-scifive_pubmedqa_question_generation_frozenwalker_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English scifive_pubmedqa_question_generation_frozenwalker T5Transformer from frozenwalker +author: John Snow Labs +name: scifive_pubmedqa_question_generation_frozenwalker +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_pubmedqa_question_generation_frozenwalker` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_frozenwalker_en_5.4.2_3.0_1724286039561.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_frozenwalker_en_5.4.2_3.0_1724286039561.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("scifive_pubmedqa_question_generation_frozenwalker","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("scifive_pubmedqa_question_generation_frozenwalker", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_pubmedqa_question_generation_frozenwalker| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/SciFive_pubmedqa_question_generation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-scifive_pubmedqa_question_generation_frozenwalker_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-scifive_pubmedqa_question_generation_frozenwalker_pipeline_en.md new file mode 100644 index 00000000000000..c90db12859b639 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-scifive_pubmedqa_question_generation_frozenwalker_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English scifive_pubmedqa_question_generation_frozenwalker_pipeline pipeline T5Transformer from frozenwalker +author: John Snow Labs +name: scifive_pubmedqa_question_generation_frozenwalker_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scifive_pubmedqa_question_generation_frozenwalker_pipeline` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_frozenwalker_pipeline_en_5.4.2_3.0_1724286086534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scifive_pubmedqa_question_generation_frozenwalker_pipeline_en_5.4.2_3.0_1724286086534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("scifive_pubmedqa_question_generation_frozenwalker_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("scifive_pubmedqa_question_generation_frozenwalker_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scifive_pubmedqa_question_generation_frozenwalker_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/SciFive_pubmedqa_question_generation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-sft_t5_en.md b/docs/_posts/ahmedlone127/2024-08-22-sft_t5_en.md new file mode 100644 index 00000000000000..9a3bcdca3209ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-sft_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sft_t5 T5Transformer from YenCao +author: John Snow Labs +name: sft_t5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_t5` is a English model originally trained by YenCao. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_t5_en_5.4.2_3.0_1724368579677.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_t5_en_5.4.2_3.0_1724368579677.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sft_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sft_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/YenCao/sft-T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-sft_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-sft_t5_pipeline_en.md new file mode 100644 index 00000000000000..bbf428b1eedcbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-sft_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sft_t5_pipeline pipeline T5Transformer from YenCao +author: John Snow Labs +name: sft_t5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sft_t5_pipeline` is a English model originally trained by YenCao. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sft_t5_pipeline_en_5.4.2_3.0_1724368713595.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sft_t5_pipeline_en_5.4.2_3.0_1724368713595.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sft_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sft_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sft_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/YenCao/sft-T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-22-shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en.md new file mode 100644 index 00000000000000..b7b5736f4ff54c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en_5.4.2_3.0_1724332705630.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_en_5.4.2_3.0_1724332705630.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|312.7 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_shuffled_graphs_with_edge_document_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..cd82c0b30d1c7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724332725178.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724332725178.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_nodes_shuffled_graphs_with_edge_document_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|312.7 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_nodes_shuffled_graphs_with_edge_document_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_en.md b/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_en.md new file mode 100644 index 00000000000000..7a4f000675a717 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_order_nodes_with_edge_label_sentence_level_t5 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_order_nodes_with_edge_label_sentence_level_t5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_order_nodes_with_edge_label_sentence_level_t5` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_with_edge_label_sentence_level_t5_en_5.4.2_3.0_1724307387428.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_with_edge_label_sentence_level_t5_en_5.4.2_3.0_1724307387428.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_order_nodes_with_edge_label_sentence_level_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_order_nodes_with_edge_label_sentence_level_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_order_nodes_with_edge_label_sentence_level_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.6 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_order_nodes_with_edge_label_sentence_level_T5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline_en.md new file mode 100644 index 00000000000000..16400793244e47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline_en_5.4.2_3.0_1724307405934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline_en_5.4.2_3.0_1724307405934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_order_nodes_with_edge_label_sentence_level_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.7 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_order_nodes_with_edge_label_sentence_level_T5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_en.md b/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_en.md new file mode 100644 index 00000000000000..40e96d10fc1c74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English shuffled_order_nodes_with_edge_label_sentence_level_t5_run2 T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_order_nodes_with_edge_label_sentence_level_t5_run2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_order_nodes_with_edge_label_sentence_level_t5_run2` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_en_5.4.2_3.0_1724318234662.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_en_5.4.2_3.0_1724318234662.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("shuffled_order_nodes_with_edge_label_sentence_level_t5_run2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("shuffled_order_nodes_with_edge_label_sentence_level_t5_run2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_order_nodes_with_edge_label_sentence_level_t5_run2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.2 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_order_nodes_with_edge_label_sentence_level_T5_run2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline_en.md new file mode 100644 index 00000000000000..2ee0947c963887 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline_en_5.4.2_3.0_1724318252725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline_en_5.4.2_3.0_1724318252725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|shuffled_order_nodes_with_edge_label_sentence_level_t5_run2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.2 MB| + +## References + +https://huggingface.co/sheoran95/shuffled_order_nodes_with_edge_label_sentence_level_T5_run2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-snli_t5_small_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-snli_t5_small_seed_2_en.md new file mode 100644 index 00000000000000..2576b19aace2d0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-snli_t5_small_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English snli_t5_small_seed_2 T5Transformer from utahnlp +author: John Snow Labs +name: snli_t5_small_seed_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`snli_t5_small_seed_2` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/snli_t5_small_seed_2_en_5.4.2_3.0_1724295879999.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/snli_t5_small_seed_2_en_5.4.2_3.0_1724295879999.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("snli_t5_small_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("snli_t5_small_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|snli_t5_small_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|328.5 MB| + +## References + +https://huggingface.co/utahnlp/snli_t5-small_seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-snli_t5_small_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-snli_t5_small_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..9b59a0e8caeba4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-snli_t5_small_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English snli_t5_small_seed_2_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: snli_t5_small_seed_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`snli_t5_small_seed_2_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/snli_t5_small_seed_2_pipeline_en_5.4.2_3.0_1724295901452.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/snli_t5_small_seed_2_pipeline_en_5.4.2_3.0_1724295901452.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("snli_t5_small_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("snli_t5_small_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|snli_t5_small_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|328.5 MB| + +## References + +https://huggingface.co/utahnlp/snli_t5-small_seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-sp_t5_base_en.md b/docs/_posts/ahmedlone127/2024-08-22-sp_t5_base_en.md new file mode 100644 index 00000000000000..e5a6f7c87c0e29 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-sp_t5_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sp_t5_base T5Transformer from startc +author: John Snow Labs +name: sp_t5_base +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sp_t5_base` is a English model originally trained by startc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sp_t5_base_en_5.4.2_3.0_1724313550033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sp_t5_base_en_5.4.2_3.0_1724313550033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sp_t5_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sp_t5_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sp_t5_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/startc/sp-t5-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-sp_t5_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-sp_t5_base_pipeline_en.md new file mode 100644 index 00000000000000..0887dd690e9671 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-sp_t5_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sp_t5_base_pipeline pipeline T5Transformer from startc +author: John Snow Labs +name: sp_t5_base_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sp_t5_base_pipeline` is a English model originally trained by startc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sp_t5_base_pipeline_en_5.4.2_3.0_1724313600451.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sp_t5_base_pipeline_en_5.4.2_3.0_1724313600451.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sp_t5_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sp_t5_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sp_t5_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/startc/sp-t5-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-spell_correction_base_id.md b/docs/_posts/ahmedlone127/2024-08-22-spell_correction_base_id.md new file mode 100644 index 00000000000000..0761ee23f8bee0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-spell_correction_base_id.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Indonesian spell_correction_base T5Transformer from Nestech +author: John Snow Labs +name: spell_correction_base +date: 2024-08-22 +tags: [id, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: id +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spell_correction_base` is a Indonesian model originally trained by Nestech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spell_correction_base_id_5.4.2_3.0_1724315981955.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spell_correction_base_id_5.4.2_3.0_1724315981955.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("spell_correction_base","id") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("spell_correction_base", "id") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spell_correction_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|id| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Nestech/spell-correction-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-spell_correction_base_pipeline_id.md b/docs/_posts/ahmedlone127/2024-08-22-spell_correction_base_pipeline_id.md new file mode 100644 index 00000000000000..f02592e75a7cb1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-spell_correction_base_pipeline_id.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Indonesian spell_correction_base_pipeline pipeline T5Transformer from Nestech +author: John Snow Labs +name: spell_correction_base_pipeline +date: 2024-08-22 +tags: [id, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: id +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`spell_correction_base_pipeline` is a Indonesian model originally trained by Nestech. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/spell_correction_base_pipeline_id_5.4.2_3.0_1724316034985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/spell_correction_base_pipeline_id_5.4.2_3.0_1724316034985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("spell_correction_base_pipeline", lang = "id") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("spell_correction_base_pipeline", lang = "id") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|spell_correction_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|id| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Nestech/spell-correction-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-speller_t5_9_en.md b/docs/_posts/ahmedlone127/2024-08-22-speller_t5_9_en.md new file mode 100644 index 00000000000000..54969c7e808cdc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-speller_t5_9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_9 T5Transformer from summervent +author: John Snow Labs +name: speller_t5_9 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_9` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_9_en_5.4.2_3.0_1724295710427.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_9_en_5.4.2_3.0_1724295710427.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-9 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-speller_t5_9_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-speller_t5_9_pipeline_en.md new file mode 100644 index 00000000000000..bfbd6ff9c3c9e9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-speller_t5_9_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_9_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_9_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_9_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_9_pipeline_en_5.4.2_3.0_1724295763691.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_9_pipeline_en_5.4.2_3.0_1724295763691.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_9_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_9_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_9_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-9 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-speller_t5_big_nepal_bhasa_en.md b/docs/_posts/ahmedlone127/2024-08-22-speller_t5_big_nepal_bhasa_en.md new file mode 100644 index 00000000000000..daf89c728beb1e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-speller_t5_big_nepal_bhasa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English speller_t5_big_nepal_bhasa T5Transformer from summervent +author: John Snow Labs +name: speller_t5_big_nepal_bhasa +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_big_nepal_bhasa` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_big_nepal_bhasa_en_5.4.2_3.0_1724291974693.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_big_nepal_bhasa_en_5.4.2_3.0_1724291974693.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("speller_t5_big_nepal_bhasa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("speller_t5_big_nepal_bhasa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_big_nepal_bhasa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-big-new \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-speller_t5_big_nepal_bhasa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-speller_t5_big_nepal_bhasa_pipeline_en.md new file mode 100644 index 00000000000000..aa4a532b1b59d7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-speller_t5_big_nepal_bhasa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English speller_t5_big_nepal_bhasa_pipeline pipeline T5Transformer from summervent +author: John Snow Labs +name: speller_t5_big_nepal_bhasa_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`speller_t5_big_nepal_bhasa_pipeline` is a English model originally trained by summervent. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/speller_t5_big_nepal_bhasa_pipeline_en_5.4.2_3.0_1724292024187.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/speller_t5_big_nepal_bhasa_pipeline_en_5.4.2_3.0_1724292024187.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("speller_t5_big_nepal_bhasa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("speller_t5_big_nepal_bhasa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|speller_t5_big_nepal_bhasa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/summervent/speller-t5-big-new + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_en.md b/docs/_posts/ahmedlone127/2024-08-22-sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_en.md new file mode 100644 index 00000000000000..68dfdc182e4429 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sum_model_lr1e_3_20_30epoch_use2e_5from20epoch T5Transformer from weny22 +author: John Snow Labs +name: sum_model_lr1e_3_20_30epoch_use2e_5from20epoch +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_lr1e_3_20_30epoch_use2e_5from20epoch` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_en_5.4.2_3.0_1724357080088.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_en_5.4.2_3.0_1724357080088.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sum_model_lr1e_3_20_30epoch_use2e_5from20epoch","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sum_model_lr1e_3_20_30epoch_use2e_5from20epoch", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_lr1e_3_20_30epoch_use2e_5from20epoch| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|420.4 MB| + +## References + +https://huggingface.co/weny22/sum_model_lr1e_3_20_30epoch_use2e-5from20epoch \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline_en.md new file mode 100644 index 00000000000000..5e31f2c4df81e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline pipeline T5Transformer from weny22 +author: John Snow Labs +name: sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline` is a English model originally trained by weny22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline_en_5.4.2_3.0_1724357100456.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline_en_5.4.2_3.0_1724357100456.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sum_model_lr1e_3_20_30epoch_use2e_5from20epoch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|420.4 MB| + +## References + +https://huggingface.co/weny22/sum_model_lr1e_3_20_30epoch_use2e-5from20epoch + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_en.md b/docs/_posts/ahmedlone127/2024-08-22-summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_en.md new file mode 100644 index 00000000000000..cdadb86f384aa8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_mesh_background_conclusion T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_mesh_background_conclusion +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_mesh_background_conclusion` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_en_5.4.2_3.0_1724301321232.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_en_5.4.2_3.0_1724301321232.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_mesh_background_conclusion","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_google_long_t5_tglobal_base_mesh_background_conclusion", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_mesh_background_conclusion| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_mesh_background_conclusion \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline_en.md new file mode 100644 index 00000000000000..9ac9dfabff6563 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline pipeline T5Transformer from acmc +author: John Snow Labs +name: summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline` is a English model originally trained by acmc. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline_en_5.4.2_3.0_1724301367248.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline_en_5.4.2_3.0_1724301367248.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_google_long_t5_tglobal_base_mesh_background_conclusion_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/acmc/summarizer_google_long-t5-tglobal-base_mesh_background_conclusion + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-summarizer_model_en.md b/docs/_posts/ahmedlone127/2024-08-22-summarizer_model_en.md new file mode 100644 index 00000000000000..71cebd59e4934c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-summarizer_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarizer_model T5Transformer from Pansu +author: John Snow Labs +name: summarizer_model +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_model` is a English model originally trained by Pansu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_model_en_5.4.2_3.0_1724348504280.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_model_en_5.4.2_3.0_1724348504280.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarizer_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarizer_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.6 MB| + +## References + +https://huggingface.co/Pansu/summarizer_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-summarizer_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-summarizer_model_pipeline_en.md new file mode 100644 index 00000000000000..7125ab0fac3bb1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-summarizer_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarizer_model_pipeline pipeline T5Transformer from Pansu +author: John Snow Labs +name: summarizer_model_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarizer_model_pipeline` is a English model originally trained by Pansu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarizer_model_pipeline_en_5.4.2_3.0_1724348521877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarizer_model_pipeline_en_5.4.2_3.0_1724348521877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarizer_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarizer_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarizer_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.6 MB| + +## References + +https://huggingface.co/Pansu/summarizer_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_1_1_lm100k_large_384_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_1_1_lm100k_large_384_en.md new file mode 100644 index 00000000000000..92b55f26e37b9c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_1_1_lm100k_large_384_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_1_1_lm100k_large_384 T5Transformer from bangnbx +author: John Snow Labs +name: t5_1_1_lm100k_large_384 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1_1_lm100k_large_384` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_large_384_en_5.4.2_3.0_1724302901391.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_large_384_en_5.4.2_3.0_1724302901391.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_1_1_lm100k_large_384","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_1_1_lm100k_large_384", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1_1_lm100k_large_384| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/bangnbx/t5.1.1.lm100k.large-384 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_1_1_lm100k_large_384_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_1_1_lm100k_large_384_pipeline_en.md new file mode 100644 index 00000000000000..36926caa99101a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_1_1_lm100k_large_384_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_1_1_lm100k_large_384_pipeline pipeline T5Transformer from bangnbx +author: John Snow Labs +name: t5_1_1_lm100k_large_384_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_1_1_lm100k_large_384_pipeline` is a English model originally trained by bangnbx. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_large_384_pipeline_en_5.4.2_3.0_1724303066837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_1_1_lm100k_large_384_pipeline_en_5.4.2_3.0_1724303066837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_1_1_lm100k_large_384_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_1_1_lm100k_large_384_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_1_1_lm100k_large_384_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/bangnbx/t5.1.1.lm100k.large-384 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_2m_large_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_2m_large_en.md new file mode 100644 index 00000000000000..b363017499cd86 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_2m_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_2m_large T5Transformer from versae +author: John Snow Labs +name: t5_2m_large +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_2m_large` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_2m_large_en_5.4.2_3.0_1724365581552.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_2m_large_en_5.4.2_3.0_1724365581552.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_2m_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_2m_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_2m_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-2m-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_2m_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_2m_large_pipeline_en.md new file mode 100644 index 00000000000000..3af124232f0cd9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_2m_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_2m_large_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_2m_large_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_2m_large_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_2m_large_pipeline_en_5.4.2_3.0_1724365717098.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_2m_large_pipeline_en_5.4.2_3.0_1724365717098.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_2m_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_2m_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_2m_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-2m-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_arxiv_2015_2017_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_arxiv_2015_2017_en.md new file mode 100644 index 00000000000000..de76472e74e38b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_arxiv_2015_2017_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2015_2017 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2015_2017 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2015_2017` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2015_2017_en_5.4.2_3.0_1724298393790.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2015_2017_en_5.4.2_3.0_1724298393790.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2015_2017","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_arxiv_2015_2017", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2015_2017| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2015-2017 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_arxiv_2015_2017_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_arxiv_2015_2017_pipeline_en.md new file mode 100644 index 00000000000000..f3375ade7dba0a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_arxiv_2015_2017_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_arxiv_2015_2017_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_arxiv_2015_2017_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_arxiv_2015_2017_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2015_2017_pipeline_en_5.4.2_3.0_1724298410598.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_arxiv_2015_2017_pipeline_en_5.4.2_3.0_1724298410598.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_arxiv_2015_2017_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_arxiv_2015_2017_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_arxiv_2015_2017_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-arxiv-2015-2017 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2012_10_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2012_10_en.md new file mode 100644 index 00000000000000..fc1fa55c6c6ca2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2012_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_10 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_10_en_5.4.2_3.0_1724286835850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_10_en_5.4.2_3.0_1724286835850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2012_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2012_10_pipeline_en.md new file mode 100644 index 00000000000000..4c2ca3ebc45d6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2012_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_10_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_10_pipeline_en_5.4.2_3.0_1724286852283.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_10_pipeline_en_5.4.2_3.0_1724286852283.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2012_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2012_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_5_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_5_en.md new file mode 100644 index 00000000000000..0323645d5594ec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_5 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_5` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_5_en_5.4.2_3.0_1724340532711.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_5_en_5.4.2_3.0_1724340532711.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_5_pipeline_en.md new file mode 100644 index 00000000000000..ff69e5ef169660 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_5_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_5_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_5_pipeline_en_5.4.2_3.0_1724340549684.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_5_pipeline_en_5.4.2_3.0_1724340549684.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2014_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2014_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_6_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_6_en.md new file mode 100644 index 00000000000000..4bcacb2e076fa6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_6 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_6_en_5.4.2_3.0_1724286950927.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_6_en_5.4.2_3.0_1724286950927.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2014_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_6_pipeline_en.md new file mode 100644 index 00000000000000..4502ca8c632ac6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2014_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2014_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2014_6_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2014_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_6_pipeline_en_5.4.2_3.0_1724286967464.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2014_6_pipeline_en_5.4.2_3.0_1724286967464.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2014_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2014_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2014_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2014-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2015_4_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2015_4_en.md new file mode 100644 index 00000000000000..a61a2b2663f238 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2015_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_4 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_4 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_4` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_4_en_5.4.2_3.0_1724330864864.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_4_en_5.4.2_3.0_1724330864864.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2015_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2015_4_pipeline_en.md new file mode 100644 index 00000000000000..b769e66502f6dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2015_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_4_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_4_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_4_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_4_pipeline_en_5.4.2_3.0_1724330881801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_4_pipeline_en_5.4.2_3.0_1724330881801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2015_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2015_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2017_10_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2017_10_en.md new file mode 100644 index 00000000000000..31c9d151414c53 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2017_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_10 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_10_en_5.4.2_3.0_1724286553272.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_10_en_5.4.2_3.0_1724286553272.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2017_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2017_10_pipeline_en.md new file mode 100644 index 00000000000000..c91e11f40343a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2017_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_10_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_10_pipeline_en_5.4.2_3.0_1724286569485.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_10_pipeline_en_5.4.2_3.0_1724286569485.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2017_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2017_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2018_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2018_1_en.md new file mode 100644 index 00000000000000..f5ff059c7bf24a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2018_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2018_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2018_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2018_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2018_1_en_5.4.2_3.0_1724353411214.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2018_1_en_5.4.2_3.0_1724353411214.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2018_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2018_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2018_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2018-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2018_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2018_1_pipeline_en.md new file mode 100644 index 00000000000000..335296bb54bee4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2018_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2018_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2018_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2018_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2018_1_pipeline_en_5.4.2_3.0_1724353429270.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2018_1_pipeline_en_5.4.2_3.0_1724353429270.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2018_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2018_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2018_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2018-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2020_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2020_2_en.md new file mode 100644 index 00000000000000..0b13a314c5a6bc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2020_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_2 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_2` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_2_en_5.4.2_3.0_1724311905616.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_2_en_5.4.2_3.0_1724311905616.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2020_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2020_2_pipeline_en.md new file mode 100644 index 00000000000000..3443150ccbbdfd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2020_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_2_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_2_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_2_pipeline_en_5.4.2_3.0_1724311922500.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_2_pipeline_en_5.4.2_3.0_1724311922500.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2020_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2020_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2021_3_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2021_3_en.md new file mode 100644 index 00000000000000..a88c4447cfb552 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2021_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_3 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_3` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_3_en_5.4.2_3.0_1724309292565.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_3_en_5.4.2_3.0_1724309292565.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2021_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2021_3_pipeline_en.md new file mode 100644 index 00000000000000..e190ce4c07cb6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_lm_wmt_2021_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_3_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_3_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_3_pipeline_en_5.4.2_3.0_1724309310163.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_3_pipeline_en_5.4.2_3.0_1724309310163.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2021_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2021_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_news_cls_2013_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_news_cls_2013_en.md new file mode 100644 index 00000000000000..4bc29e608e9169 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_news_cls_2013_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_news_cls_2013 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_news_cls_2013 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_news_cls_2013` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_news_cls_2013_en_5.4.2_3.0_1724292874931.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_news_cls_2013_en_5.4.2_3.0_1724292874931.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_news_cls_2013","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_news_cls_2013", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_news_cls_2013| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-news_cls-2013 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_news_cls_2013_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_news_cls_2013_pipeline_en.md new file mode 100644 index 00000000000000..5db31734392661 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_news_cls_2013_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_news_cls_2013_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_news_cls_2013_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_news_cls_2013_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_news_cls_2013_pipeline_en_5.4.2_3.0_1724292894997.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_news_cls_2013_pipeline_en_5.4.2_3.0_1724292894997.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_news_cls_2013_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_news_cls_2013_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_news_cls_2013_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-news_cls-2013 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2015_10_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2015_10_en.md new file mode 100644 index 00000000000000..04a60f17ff1104 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2015_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_10 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_10 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_10` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_10_en_5.4.2_3.0_1724304941077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_10_en_5.4.2_3.0_1724304941077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2015_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|295.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2015_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2015_10_pipeline_en.md new file mode 100644 index 00000000000000..089c6497c031c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2015_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2015_10_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2015_10_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2015_10_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_10_pipeline_en_5.4.2_3.0_1724304970773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2015_10_pipeline_en_5.4.2_3.0_1724304970773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2015_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2015_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2015_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|295.5 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2015-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_1_en.md new file mode 100644 index 00000000000000..9bcfefd1fd2ec7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_1_en_5.4.2_3.0_1724367649949.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_1_en_5.4.2_3.0_1724367649949.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|293.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_1_pipeline_en.md new file mode 100644 index 00000000000000..9cb4eed830bf68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_1_pipeline_en_5.4.2_3.0_1724367680954.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_1_pipeline_en_5.4.2_3.0_1724367680954.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2016_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2016_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|293.7 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_6_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_6_en.md new file mode 100644 index 00000000000000..ec172366c39406 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_6 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_6 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_6` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_6_en_5.4.2_3.0_1724363380588.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_6_en_5.4.2_3.0_1724363380588.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2016_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.3 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_6_pipeline_en.md new file mode 100644 index 00000000000000..3cf15d86be9d19 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2016_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2016_6_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2016_6_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2016_6_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_6_pipeline_en_5.4.2_3.0_1724363409166.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2016_6_pipeline_en_5.4.2_3.0_1724363409166.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2016_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2016_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2016_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.3 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2016-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_0_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_0_en.md new file mode 100644 index 00000000000000..0f86b4ff628bf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_0 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_0` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_0_en_5.4.2_3.0_1724369147871.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_0_en_5.4.2_3.0_1724369147871.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_0_pipeline_en.md new file mode 100644 index 00000000000000..3c260452d7535d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_0_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_0_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_0_pipeline_en_5.4.2_3.0_1724369176763.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_0_pipeline_en_5.4.2_3.0_1724369176763.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2017_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2017_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_en.md new file mode 100644 index 00000000000000..7fbb5547b216da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_en_5.4.2_3.0_1724316475879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_en_5.4.2_3.0_1724316475879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2017", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|321.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_pipeline_en.md new file mode 100644 index 00000000000000..6aaf210724e61d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2017_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2017_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2017_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2017_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_pipeline_en_5.4.2_3.0_1724316502721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2017_pipeline_en_5.4.2_3.0_1724316502721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2017_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2017_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2017_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|321.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2017 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2019_11_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2019_11_en.md new file mode 100644 index 00000000000000..93a4b7708b19b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2019_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_11 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_11 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_11` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_11_en_5.4.2_3.0_1724334117691.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_11_en_5.4.2_3.0_1724334117691.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2019_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2019_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2019_11_pipeline_en.md new file mode 100644 index 00000000000000..61f118bb199602 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_60m_poli_aff_2019_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2019_11_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2019_11_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2019_11_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_11_pipeline_en_5.4.2_3.0_1724334145948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2019_11_pipeline_en_5.4.2_3.0_1724334145948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2019_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2019_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2019_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.8 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2019-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_6m_large_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_6m_large_en.md new file mode 100644 index 00000000000000..160072fdf9d998 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_6m_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_6m_large T5Transformer from versae +author: John Snow Labs +name: t5_6m_large +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_6m_large` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_6m_large_en_5.4.2_3.0_1724361538083.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_6m_large_en_5.4.2_3.0_1724361538083.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_6m_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_6m_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_6m_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-6m-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_6m_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_6m_large_pipeline_en.md new file mode 100644 index 00000000000000..69e51a8aa89bb0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_6m_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_6m_large_pipeline pipeline T5Transformer from versae +author: John Snow Labs +name: t5_6m_large_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_6m_large_pipeline` is a English model originally trained by versae. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_6m_large_pipeline_en_5.4.2_3.0_1724361674862.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_6m_large_pipeline_en_5.4.2_3.0_1724361674862.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_6m_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_6m_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_6m_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/versae/t5-6m-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_70_articles_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_70_articles_en.md new file mode 100644 index 00000000000000..27fcdd45cd5fff --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_70_articles_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_70_articles T5Transformer from Worldman +author: John Snow Labs +name: t5_70_articles +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_70_articles` is a English model originally trained by Worldman. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_70_articles_en_5.4.2_3.0_1724355917128.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_70_articles_en_5.4.2_3.0_1724355917128.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_70_articles","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_70_articles", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_70_articles| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|796.2 MB| + +## References + +https://huggingface.co/Worldman/t5_70_articles \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_70_articles_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_70_articles_pipeline_en.md new file mode 100644 index 00000000000000..c72dac83c7a1ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_70_articles_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_70_articles_pipeline pipeline T5Transformer from Worldman +author: John Snow Labs +name: t5_70_articles_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_70_articles_pipeline` is a English model originally trained by Worldman. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_70_articles_pipeline_en_5.4.2_3.0_1724356012646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_70_articles_pipeline_en_5.4.2_3.0_1724356012646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_70_articles_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_70_articles_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_70_articles_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|796.2 MB| + +## References + +https://huggingface.co/Worldman/t5_70_articles + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_academic_paraphraser_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_academic_paraphraser_en.md new file mode 100644 index 00000000000000..17ab3333a4aef1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_academic_paraphraser_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_academic_paraphraser T5Transformer from NIRVANA +author: John Snow Labs +name: t5_academic_paraphraser +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_academic_paraphraser` is a English model originally trained by NIRVANA. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_academic_paraphraser_en_5.4.2_3.0_1724344707083.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_academic_paraphraser_en_5.4.2_3.0_1724344707083.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_academic_paraphraser","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_academic_paraphraser", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_academic_paraphraser| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/NIRVANA/T5_academic_paraphraser \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_academic_paraphraser_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_academic_paraphraser_pipeline_en.md new file mode 100644 index 00000000000000..1951c637adef64 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_academic_paraphraser_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_academic_paraphraser_pipeline pipeline T5Transformer from NIRVANA +author: John Snow Labs +name: t5_academic_paraphraser_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_academic_paraphraser_pipeline` is a English model originally trained by NIRVANA. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_academic_paraphraser_pipeline_en_5.4.2_3.0_1724344756161.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_academic_paraphraser_pipeline_en_5.4.2_3.0_1724344756161.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_academic_paraphraser_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_academic_paraphraser_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_academic_paraphraser_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/NIRVANA/T5_academic_paraphraser + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_bt0_khanq_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_bt0_khanq_en.md new file mode 100644 index 00000000000000..6a26625c82f248 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_bt0_khanq_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_bt0_khanq T5Transformer from xiaothung +author: John Snow Labs +name: t5_base_bt0_khanq +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_bt0_khanq` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_bt0_khanq_en_5.4.2_3.0_1724319409726.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_bt0_khanq_en_5.4.2_3.0_1724319409726.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_bt0_khanq","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_bt0_khanq", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_bt0_khanq| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/t5-base-bt0-khanq \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_bt0_khanq_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_bt0_khanq_pipeline_en.md new file mode 100644 index 00000000000000..05ebe7a6e35f2b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_bt0_khanq_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_bt0_khanq_pipeline pipeline T5Transformer from xiaothung +author: John Snow Labs +name: t5_base_bt0_khanq_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_bt0_khanq_pipeline` is a English model originally trained by xiaothung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_bt0_khanq_pipeline_en_5.4.2_3.0_1724319458346.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_bt0_khanq_pipeline_en_5.4.2_3.0_1724319458346.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_bt0_khanq_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_bt0_khanq_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_bt0_khanq_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/xiaothung/t5-base-bt0-khanq + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_en.md new file mode 100644 index 00000000000000..951e0b769ae290 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_c2_mare_ar1_ex8_half_from_ft_dense T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_c2_mare_ar1_ex8_half_from_ft_dense +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c2_mare_ar1_ex8_half_from_ft_dense` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_from_ft_dense_en_5.4.2_3.0_1724285125723.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_from_ft_dense_en_5.4.2_3.0_1724285125723.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_c2_mare_ar1_ex8_half_from_ft_dense","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_c2_mare_ar1_ex8_half_from_ft_dense", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c2_mare_ar1_ex8_half_from_ft_dense| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_c2_mare_ar1_ex8_half_from_ft_dense \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline_en.md new file mode 100644 index 00000000000000..1332d325b71ea6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline_en_5.4.2_3.0_1724285274373.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline_en_5.4.2_3.0_1724285274373.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c2_mare_ar1_ex8_half_from_ft_dense_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_c2_mare_ar1_ex8_half_from_ft_dense + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_en.md new file mode 100644 index 00000000000000..be2f6372a27d6e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_en_5.4.2_3.0_1724334783878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_en_5.4.2_3.0_1724334783878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline_en.md new file mode 100644 index 00000000000000..26a3cc3164ef97 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline_en_5.4.2_3.0_1724334933335.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline_en_5.4.2_3.0_1724334933335.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_c2_mare_ar1_ex8_half_from_ft_dense_with_sort + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_clariq_ccqg_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_clariq_ccqg_en.md new file mode 100644 index 00000000000000..cde58f6e937d2c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_clariq_ccqg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_clariq_ccqg T5Transformer from DylanJHJ +author: John Snow Labs +name: t5_base_clariq_ccqg +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_clariq_ccqg` is a English model originally trained by DylanJHJ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_clariq_ccqg_en_5.4.2_3.0_1724333260233.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_clariq_ccqg_en_5.4.2_3.0_1724333260233.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_clariq_ccqg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_clariq_ccqg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_clariq_ccqg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/DylanJHJ/t5-base-clariq-ccqg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_clariq_ccqg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_clariq_ccqg_pipeline_en.md new file mode 100644 index 00000000000000..d596b4c03329af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_clariq_ccqg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_clariq_ccqg_pipeline pipeline T5Transformer from DylanJHJ +author: John Snow Labs +name: t5_base_clariq_ccqg_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_clariq_ccqg_pipeline` is a English model originally trained by DylanJHJ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_clariq_ccqg_pipeline_en_5.4.2_3.0_1724333432657.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_clariq_ccqg_pipeline_en_5.4.2_3.0_1724333432657.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_clariq_ccqg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_clariq_ccqg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_clariq_ccqg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.8 MB| + +## References + +https://huggingface.co/DylanJHJ/t5-base-clariq-ccqg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_commom_sense_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_commom_sense_en.md new file mode 100644 index 00000000000000..2163b12fd8a009 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_commom_sense_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_commom_sense T5Transformer from guyhadad01 +author: John Snow Labs +name: t5_base_commom_sense +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_commom_sense` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_commom_sense_en_5.4.2_3.0_1724329052156.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_commom_sense_en_5.4.2_3.0_1724329052156.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_commom_sense","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_commom_sense", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_commom_sense| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|996.2 MB| + +## References + +https://huggingface.co/guyhadad01/t5-base-commom-sense \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_commom_sense_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_commom_sense_pipeline_en.md new file mode 100644 index 00000000000000..3613897f6863f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_commom_sense_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_commom_sense_pipeline pipeline T5Transformer from guyhadad01 +author: John Snow Labs +name: t5_base_commom_sense_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_commom_sense_pipeline` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_commom_sense_pipeline_en_5.4.2_3.0_1724329100155.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_commom_sense_pipeline_en_5.4.2_3.0_1724329100155.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_commom_sense_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_commom_sense_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_commom_sense_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|996.2 MB| + +## References + +https://huggingface.co/guyhadad01/t5-base-commom-sense + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_1024_finetuned_squad_seed_0_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_1024_finetuned_squad_seed_0_en.md new file mode 100644 index 00000000000000..16270f37250d7e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_1024_finetuned_squad_seed_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_1024_finetuned_squad_seed_0 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_1024_finetuned_squad_seed_0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_1024_finetuned_squad_seed_0` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_seed_0_en_5.4.2_3.0_1724292208643.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_seed_0_en_5.4.2_3.0_1724292208643.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_1024_finetuned_squad_seed_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_1024_finetuned_squad_seed_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_1024_finetuned_squad_seed_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|974.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-1024-finetuned-squad-seed-0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline_en.md new file mode 100644 index 00000000000000..56b102d4216098 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline_en_5.4.2_3.0_1724292267294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline_en_5.4.2_3.0_1724292267294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_1024_finetuned_squad_seed_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|974.6 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-1024-finetuned-squad-seed-0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_en.md new file mode 100644 index 00000000000000..b8d12c143fc8a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724324009880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_en_5.4.2_3.0_1724324009880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|938.9 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-infilling-seed-4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline_en.md new file mode 100644 index 00000000000000..c55dc9ee8dee82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724324079352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline_en_5.4.2_3.0_1724324079352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_few_shot_k_64_finetuned_squad_infilling_seed_4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|938.9 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-base-few-shot-k-64-finetuned-squad-infilling-seed-4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_bias_99c3c657_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_bias_99c3c657_en.md new file mode 100644 index 00000000000000..87fb7fb3db2d99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_bias_99c3c657_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_bias_99c3c657 T5Transformer from ajsmith201 +author: John Snow Labs +name: t5_base_finetuned_bias_99c3c657 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_bias_99c3c657` is a English model originally trained by ajsmith201. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_bias_99c3c657_en_5.4.2_3.0_1724368276405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_bias_99c3c657_en_5.4.2_3.0_1724368276405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_bias_99c3c657","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_bias_99c3c657", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_bias_99c3c657| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ajsmith201/t5-base-finetuned-bias-99c3c657 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_bias_99c3c657_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_bias_99c3c657_pipeline_en.md new file mode 100644 index 00000000000000..51b71799efe425 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_bias_99c3c657_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_bias_99c3c657_pipeline pipeline T5Transformer from ajsmith201 +author: John Snow Labs +name: t5_base_finetuned_bias_99c3c657_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_bias_99c3c657_pipeline` is a English model originally trained by ajsmith201. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_bias_99c3c657_pipeline_en_5.4.2_3.0_1724368323837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_bias_99c3c657_pipeline_en_5.4.2_3.0_1724368323837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_bias_99c3c657_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_bias_99c3c657_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_bias_99c3c657_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ajsmith201/t5-base-finetuned-bias-99c3c657 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_spanish_tonga_tonga_islands_guc_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_spanish_tonga_tonga_islands_guc_en.md new file mode 100644 index 00000000000000..2d8ed0138e1f78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_spanish_tonga_tonga_islands_guc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_spanish_tonga_tonga_islands_guc T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_spanish_tonga_tonga_islands_guc +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_spanish_tonga_tonga_islands_guc` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_guc_en_5.4.2_3.0_1724358665038.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_guc_en_5.4.2_3.0_1724358665038.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_spanish_tonga_tonga_islands_guc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_spanish_tonga_tonga_islands_guc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_spanish_tonga_tonga_islands_guc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|958.4 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-es-to-guc \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline_en.md new file mode 100644 index 00000000000000..23de6073a5614a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline pipeline T5Transformer from mekjr1 +author: John Snow Labs +name: t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline` is a English model originally trained by mekjr1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline_en_5.4.2_3.0_1724358715028.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline_en_5.4.2_3.0_1724358715028.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_spanish_tonga_tonga_islands_guc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|958.5 MB| + +## References + +https://huggingface.co/mekjr1/t5-base-finetuned-es-to-guc + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_swag_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_swag_en.md new file mode 100644 index 00000000000000..a82d98a1b871aa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_swag_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_swag T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_swag +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_swag` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_swag_en_5.4.2_3.0_1724307311916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_swag_en_5.4.2_3.0_1724307311916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_swag","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_swag", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_swag| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|942.5 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-swag \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_swag_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_swag_pipeline_en.md new file mode 100644 index 00000000000000..50991fde04eadb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_swag_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_swag_pipeline pipeline T5Transformer from mrm8488 +author: John Snow Labs +name: t5_base_finetuned_swag_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_swag_pipeline` is a English model originally trained by mrm8488. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_swag_pipeline_en_5.4.2_3.0_1724307378668.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_swag_pipeline_en_5.4.2_3.0_1724307378668.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_swag_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_swag_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_swag_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|942.5 MB| + +## References + +https://huggingface.co/mrm8488/t5-base-finetuned-swag + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_xsum_gman007_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_xsum_gman007_en.md new file mode 100644 index 00000000000000..948e453d5f208b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_xsum_gman007_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_xsum_gman007 T5Transformer from gman007 +author: John Snow Labs +name: t5_base_finetuned_xsum_gman007 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_xsum_gman007` is a English model originally trained by gman007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_gman007_en_5.4.2_3.0_1724336925108.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_gman007_en_5.4.2_3.0_1724336925108.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_xsum_gman007","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_xsum_gman007", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_xsum_gman007| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|957.3 MB| + +## References + +https://huggingface.co/gman007/t5-base-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_xsum_gman007_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_xsum_gman007_pipeline_en.md new file mode 100644 index 00000000000000..55b7fa7681be66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_finetuned_xsum_gman007_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_xsum_gman007_pipeline pipeline T5Transformer from gman007 +author: John Snow Labs +name: t5_base_finetuned_xsum_gman007_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_xsum_gman007_pipeline` is a English model originally trained by gman007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_gman007_pipeline_en_5.4.2_3.0_1724336979168.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_xsum_gman007_pipeline_en_5.4.2_3.0_1724336979168.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_xsum_gman007_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_xsum_gman007_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_xsum_gman007_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|957.3 MB| + +## References + +https://huggingface.co/gman007/t5-base-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_gec_florentianayuwono_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_gec_florentianayuwono_en.md new file mode 100644 index 00000000000000..648efb0885f122 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_gec_florentianayuwono_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_gec_florentianayuwono T5Transformer from florentianayuwono +author: John Snow Labs +name: t5_base_gec_florentianayuwono +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_gec_florentianayuwono` is a English model originally trained by florentianayuwono. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_gec_florentianayuwono_en_5.4.2_3.0_1724325611418.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_gec_florentianayuwono_en_5.4.2_3.0_1724325611418.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_gec_florentianayuwono","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_gec_florentianayuwono", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_gec_florentianayuwono| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.9 MB| + +## References + +https://huggingface.co/florentianayuwono/t5-base-gec \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_gec_florentianayuwono_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_gec_florentianayuwono_pipeline_en.md new file mode 100644 index 00000000000000..082c7492029433 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_gec_florentianayuwono_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_gec_florentianayuwono_pipeline pipeline T5Transformer from florentianayuwono +author: John Snow Labs +name: t5_base_gec_florentianayuwono_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_gec_florentianayuwono_pipeline` is a English model originally trained by florentianayuwono. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_gec_florentianayuwono_pipeline_en_5.4.2_3.0_1724325631087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_gec_florentianayuwono_pipeline_en_5.4.2_3.0_1724325631087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_gec_florentianayuwono_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_gec_florentianayuwono_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_gec_florentianayuwono_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.9 MB| + +## References + +https://huggingface.co/florentianayuwono/t5-base-gec + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_livedoor_news_corpus_kon_ch_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_livedoor_news_corpus_kon_ch_pipeline_en.md new file mode 100644 index 00000000000000..9f570563ea4144 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_livedoor_news_corpus_kon_ch_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_long_livedoor_news_corpus_kon_ch_pipeline pipeline T5Transformer from KON-ch +author: John Snow Labs +name: t5_base_long_livedoor_news_corpus_kon_ch_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_livedoor_news_corpus_kon_ch_pipeline` is a English model originally trained by KON-ch. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_kon_ch_pipeline_en_5.4.2_3.0_1724305499137.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_livedoor_news_corpus_kon_ch_pipeline_en_5.4.2_3.0_1724305499137.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_long_livedoor_news_corpus_kon_ch_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_long_livedoor_news_corpus_kon_ch_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_livedoor_news_corpus_kon_ch_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/KON-ch/t5-base-long-livedoor-news-corpus + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_qkquiz_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_qkquiz_en.md new file mode 100644 index 00000000000000..ac7c713d928468 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_qkquiz_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_long_qkquiz T5Transformer from ymorioka +author: John Snow Labs +name: t5_base_long_qkquiz +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_qkquiz` is a English model originally trained by ymorioka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_qkquiz_en_5.4.2_3.0_1724292613225.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_qkquiz_en_5.4.2_3.0_1724292613225.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_long_qkquiz","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_long_qkquiz", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_qkquiz| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ymorioka/t5-base-long-qkquiz \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_qkquiz_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_qkquiz_pipeline_en.md new file mode 100644 index 00000000000000..bad93243d5cc71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_long_qkquiz_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_long_qkquiz_pipeline pipeline T5Transformer from ymorioka +author: John Snow Labs +name: t5_base_long_qkquiz_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_qkquiz_pipeline` is a English model originally trained by ymorioka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_qkquiz_pipeline_en_5.4.2_3.0_1724292660542.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_qkquiz_pipeline_en_5.4.2_3.0_1724292660542.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_long_qkquiz_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_long_qkquiz_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_qkquiz_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ymorioka/t5-base-long-qkquiz + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_lora_combined_webnlg_e10_256_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_lora_combined_webnlg_e10_256_en.md new file mode 100644 index 00000000000000..aff17b2433f78c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_lora_combined_webnlg_e10_256_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_lora_combined_webnlg_e10_256 T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_lora_combined_webnlg_e10_256 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lora_combined_webnlg_e10_256` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lora_combined_webnlg_e10_256_en_5.4.2_3.0_1724295002002.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lora_combined_webnlg_e10_256_en_5.4.2_3.0_1724295002002.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_lora_combined_webnlg_e10_256","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_lora_combined_webnlg_e10_256", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lora_combined_webnlg_e10_256| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|884.2 MB| + +## References + +https://huggingface.co/OneFly7/T5-base-lora-combined-webnlg-e10-256 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_lora_combined_webnlg_e10_256_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_lora_combined_webnlg_e10_256_pipeline_en.md new file mode 100644 index 00000000000000..96c5b108c6505f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_lora_combined_webnlg_e10_256_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_lora_combined_webnlg_e10_256_pipeline pipeline T5Transformer from OneFly7 +author: John Snow Labs +name: t5_base_lora_combined_webnlg_e10_256_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_lora_combined_webnlg_e10_256_pipeline` is a English model originally trained by OneFly7. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_lora_combined_webnlg_e10_256_pipeline_en_5.4.2_3.0_1724295085679.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_lora_combined_webnlg_e10_256_pipeline_en_5.4.2_3.0_1724295085679.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_lora_combined_webnlg_e10_256_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_lora_combined_webnlg_e10_256_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_lora_combined_webnlg_e10_256_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|884.2 MB| + +## References + +https://huggingface.co/OneFly7/T5-base-lora-combined-webnlg-e10-256 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_model_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_model_en.md new file mode 100644 index 00000000000000..c0bdae60aa6f59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_model T5Transformer from vy2388 +author: John Snow Labs +name: t5_base_model +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_model` is a English model originally trained by vy2388. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_model_en_5.4.2_3.0_1724334913339.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_model_en_5.4.2_3.0_1724334913339.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vy2388/T5_base_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_model_pipeline_en.md new file mode 100644 index 00000000000000..487a7646d8a19a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_model_pipeline pipeline T5Transformer from vy2388 +author: John Snow Labs +name: t5_base_model_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_model_pipeline` is a English model originally trained by vy2388. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_model_pipeline_en_5.4.2_3.0_1724334962707.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_model_pipeline_en_5.4.2_3.0_1724334962707.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vy2388/T5_base_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_msmarco_squad_query_generation_longp_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_msmarco_squad_query_generation_longp_v2_en.md new file mode 100644 index 00000000000000..b7f079d532ca17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_msmarco_squad_query_generation_longp_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_msmarco_squad_query_generation_longp_v2 T5Transformer from jmvcoelho +author: John Snow Labs +name: t5_base_msmarco_squad_query_generation_longp_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_msmarco_squad_query_generation_longp_v2` is a English model originally trained by jmvcoelho. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_msmarco_squad_query_generation_longp_v2_en_5.4.2_3.0_1724330247811.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_msmarco_squad_query_generation_longp_v2_en_5.4.2_3.0_1724330247811.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_msmarco_squad_query_generation_longp_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_msmarco_squad_query_generation_longp_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_msmarco_squad_query_generation_longp_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jmvcoelho/t5-base-msmarco-squad-query-generation-longp-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_msmarco_squad_query_generation_longp_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_msmarco_squad_query_generation_longp_v2_pipeline_en.md new file mode 100644 index 00000000000000..94a8b692bff920 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_msmarco_squad_query_generation_longp_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_msmarco_squad_query_generation_longp_v2_pipeline pipeline T5Transformer from jmvcoelho +author: John Snow Labs +name: t5_base_msmarco_squad_query_generation_longp_v2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_msmarco_squad_query_generation_longp_v2_pipeline` is a English model originally trained by jmvcoelho. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_msmarco_squad_query_generation_longp_v2_pipeline_en_5.4.2_3.0_1724330294454.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_msmarco_squad_query_generation_longp_v2_pipeline_en_5.4.2_3.0_1724330294454.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_msmarco_squad_query_generation_longp_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_msmarco_squad_query_generation_longp_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_msmarco_squad_query_generation_longp_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jmvcoelho/t5-base-msmarco-squad-query-generation-longp-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_ncc_lm_normail_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_ncc_lm_normail_en.md new file mode 100644 index 00000000000000..101c840b0c231b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_ncc_lm_normail_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_ncc_lm_normail T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: t5_base_ncc_lm_normail +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_lm_normail` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_normail_en_5.4.2_3.0_1724314431265.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_normail_en_5.4.2_3.0_1724314431265.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_ncc_lm_normail","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_ncc_lm_normail", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_lm_normail| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/t5_base_NCC_lm-normail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_ncc_lm_normail_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_ncc_lm_normail_pipeline_en.md new file mode 100644 index 00000000000000..8d6b2963ef46a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_ncc_lm_normail_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_ncc_lm_normail_pipeline pipeline T5Transformer from bg79-v23-bidata-ntnu +author: John Snow Labs +name: t5_base_ncc_lm_normail_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_ncc_lm_normail_pipeline` is a English model originally trained by bg79-v23-bidata-ntnu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_normail_pipeline_en_5.4.2_3.0_1724314560469.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_ncc_lm_normail_pipeline_en_5.4.2_3.0_1724314560469.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_ncc_lm_normail_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_ncc_lm_normail_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_ncc_lm_normail_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/bg79-v23-bidata-ntnu/t5_base_NCC_lm-normail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_pointer_adv_top_v2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_pointer_adv_top_v2_en.md new file mode 100644 index 00000000000000..b35480efad97ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_pointer_adv_top_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_pointer_adv_top_v2 T5Transformer from WillHeld +author: John Snow Labs +name: t5_base_pointer_adv_top_v2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_pointer_adv_top_v2` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_pointer_adv_top_v2_en_5.4.2_3.0_1724304381732.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_pointer_adv_top_v2_en_5.4.2_3.0_1724304381732.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_pointer_adv_top_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_pointer_adv_top_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_pointer_adv_top_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/WillHeld/t5-base-pointer-adv-top_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_pointer_adv_top_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_pointer_adv_top_v2_pipeline_en.md new file mode 100644 index 00000000000000..15961f74fa6e5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_pointer_adv_top_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_pointer_adv_top_v2_pipeline pipeline T5Transformer from WillHeld +author: John Snow Labs +name: t5_base_pointer_adv_top_v2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_pointer_adv_top_v2_pipeline` is a English model originally trained by WillHeld. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_pointer_adv_top_v2_pipeline_en_5.4.2_3.0_1724304668828.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_pointer_adv_top_v2_pipeline_en_5.4.2_3.0_1724304668828.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_pointer_adv_top_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_pointer_adv_top_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_pointer_adv_top_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/WillHeld/t5-base-pointer-adv-top_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_qasc_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_qasc_en.md new file mode 100644 index 00000000000000..a3ee478bcbcdd9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_qasc_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_qasc T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_base_qasc +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qasc` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qasc_en_5.4.2_3.0_1724338827863.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qasc_en_5.4.2_3.0_1724338827863.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_qasc","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_qasc", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qasc| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|987.8 MB| + +## References + +https://huggingface.co/SeongwooKim/T5-base-qasc \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_qasc_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_qasc_pipeline_en.md new file mode 100644 index 00000000000000..09d3cb1fd6b0bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_qasc_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_qasc_pipeline pipeline T5Transformer from SeongwooKim +author: John Snow Labs +name: t5_base_qasc_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_qasc_pipeline` is a English model originally trained by SeongwooKim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_qasc_pipeline_en_5.4.2_3.0_1724338882382.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_qasc_pipeline_en_5.4.2_3.0_1724338882382.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_qasc_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_qasc_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_qasc_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|987.8 MB| + +## References + +https://huggingface.co/SeongwooKim/T5-base-qasc + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_rlhf_bm25_amazon_beauty_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_rlhf_bm25_amazon_beauty_en.md new file mode 100644 index 00000000000000..6e2eaac90aa9a6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_rlhf_bm25_amazon_beauty_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_amazon_beauty T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_amazon_beauty +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_amazon_beauty` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_amazon_beauty_en_5.4.2_3.0_1724347563957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_amazon_beauty_en_5.4.2_3.0_1724347563957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_amazon_beauty","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rlhf_bm25_amazon_beauty", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_amazon_beauty| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|986.7 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-amazon-beauty \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_rlhf_bm25_amazon_beauty_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_rlhf_bm25_amazon_beauty_pipeline_en.md new file mode 100644 index 00000000000000..43c8b0ee3da894 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_rlhf_bm25_amazon_beauty_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rlhf_bm25_amazon_beauty_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_rlhf_bm25_amazon_beauty_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rlhf_bm25_amazon_beauty_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_amazon_beauty_pipeline_en_5.4.2_3.0_1724347619527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rlhf_bm25_amazon_beauty_pipeline_en_5.4.2_3.0_1724347619527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rlhf_bm25_amazon_beauty_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rlhf_bm25_amazon_beauty_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rlhf_bm25_amazon_beauty_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|986.7 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-rlhf-bm25-amazon-beauty + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_samsum_seed17_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_samsum_seed17_en.md new file mode 100644 index 00000000000000..1ad064cb36c1d5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_samsum_seed17_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_samsum_seed17 T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_samsum_seed17 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_samsum_seed17` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed17_en_5.4.2_3.0_1724288222107.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed17_en_5.4.2_3.0_1724288222107.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_samsum_seed17","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_samsum_seed17", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_samsum_seed17| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-samsum-seed17 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline_en.md new file mode 100644 index 00000000000000..725e296f27fe30 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline_en_5.4.2_3.0_1724288268338.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline_en_5.4.2_3.0_1724288268338.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_samsum_seed17_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-samsum-seed17 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_seed55_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_seed55_en.md new file mode 100644 index 00000000000000..7fcb28e3ca0a12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_seed55_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_seed55 T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_seed55 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_seed55` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed55_en_5.4.2_3.0_1724348918451.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed55_en_5.4.2_3.0_1724348918451.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_seed55","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_samsumgen_xsum_conv_seed55", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_seed55| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-seed55 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_seed55_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_seed55_pipeline_en.md new file mode 100644 index 00000000000000..62bef0bddc74f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_samsumgen_xsum_conv_seed55_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_samsumgen_xsum_conv_seed55_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_samsumgen_xsum_conv_seed55_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_samsumgen_xsum_conv_seed55_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed55_pipeline_en_5.4.2_3.0_1724348965247.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_samsumgen_xsum_conv_seed55_pipeline_en_5.4.2_3.0_1724348965247.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_samsumgen_xsum_conv_seed55_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_samsumgen_xsum_conv_seed55_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_samsumgen_xsum_conv_seed55_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-samsumgen-xsum-conv-seed55 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_amazon_phones_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_amazon_phones_en.md new file mode 100644 index 00000000000000..958c30923221f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_amazon_phones_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_sft_amazon_phones T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_amazon_phones +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_amazon_phones` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_amazon_phones_en_5.4.2_3.0_1724335290427.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_amazon_phones_en_5.4.2_3.0_1724335290427.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_sft_amazon_phones","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_sft_amazon_phones", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_amazon_phones| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.9 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-amazon-phones \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_amazon_phones_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_amazon_phones_pipeline_en.md new file mode 100644 index 00000000000000..737b0dba806d82 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_amazon_phones_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_sft_amazon_phones_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_amazon_phones_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_amazon_phones_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_amazon_phones_pipeline_en_5.4.2_3.0_1724335350713.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_amazon_phones_pipeline_en_5.4.2_3.0_1724335350713.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_sft_amazon_phones_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_sft_amazon_phones_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_amazon_phones_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.9 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-amazon-phones + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_clothing_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_clothing_en.md new file mode 100644 index 00000000000000..29be8aa2a76f59 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_clothing_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_sft_clothing T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_clothing +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_clothing` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_clothing_en_5.4.2_3.0_1724354015150.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_clothing_en_5.4.2_3.0_1724354015150.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_sft_clothing","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_sft_clothing", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_clothing| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|976.3 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-clothing \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_clothing_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_clothing_pipeline_en.md new file mode 100644 index 00000000000000..f94dc678f1662d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_sft_clothing_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_sft_clothing_pipeline pipeline T5Transformer from yashonwu +author: John Snow Labs +name: t5_base_sft_clothing_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_sft_clothing_pipeline` is a English model originally trained by yashonwu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_sft_clothing_pipeline_en_5.4.2_3.0_1724354072782.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_sft_clothing_pipeline_en_5.4.2_3.0_1724354072782.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_sft_clothing_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_sft_clothing_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_sft_clothing_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|976.3 MB| + +## References + +https://huggingface.co/yashonwu/t5-base-sft-clothing + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_tedxjp_6body_0context_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_tedxjp_6body_0context_en.md new file mode 100644 index 00000000000000..ac528ac04353a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_tedxjp_6body_0context_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_6body_0context T5Transformer from tyoyo +author: John Snow Labs +name: t5_base_tedxjp_6body_0context +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_6body_0context` is a English model originally trained by tyoyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_6body_0context_en_5.4.2_3.0_1724298281112.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_6body_0context_en_5.4.2_3.0_1724298281112.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_6body_0context","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_6body_0context", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_6body_0context| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tyoyo/t5-base-TEDxJP-6body-0context \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_tedxjp_6body_0context_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_tedxjp_6body_0context_pipeline_en.md new file mode 100644 index 00000000000000..a377651323c6fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_tedxjp_6body_0context_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_6body_0context_pipeline pipeline T5Transformer from tyoyo +author: John Snow Labs +name: t5_base_tedxjp_6body_0context_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_6body_0context_pipeline` is a English model originally trained by tyoyo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_6body_0context_pipeline_en_5.4.2_3.0_1724298330747.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_6body_0context_pipeline_en_5.4.2_3.0_1724298330747.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_6body_0context_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_6body_0context_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_6body_0context_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tyoyo/t5-base-TEDxJP-6body-0context + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_en.md new file mode 100644 index 00000000000000..eab35def307b48 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55 T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_en_5.4.2_3.0_1724353996793.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_en_5.4.2_3.0_1724353996793.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsummgen-xsum-conv-tweetsumm-seed55 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline_en.md new file mode 100644 index 00000000000000..8382e64ea1c168 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline_en_5.4.2_3.0_1724354045067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline_en_5.4.2_3.0_1724354045067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsummgen_xsum_conv_tweetsumm_seed55_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsummgen-xsum-conv-tweetsumm-seed55 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_v2_v18_edos_labelled_aggregated_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_v2_v18_edos_labelled_aggregated_en.md new file mode 100644 index 00000000000000..946508084147b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_v2_v18_edos_labelled_aggregated_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_v2_v18_edos_labelled_aggregated T5Transformer from harshuos +author: John Snow Labs +name: t5_base_v2_v18_edos_labelled_aggregated +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_v2_v18_edos_labelled_aggregated` is a English model originally trained by harshuos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_v2_v18_edos_labelled_aggregated_en_5.4.2_3.0_1724301429040.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_v2_v18_edos_labelled_aggregated_en_5.4.2_3.0_1724301429040.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_v2_v18_edos_labelled_aggregated","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_v2_v18_edos_labelled_aggregated", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_v2_v18_edos_labelled_aggregated| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|956.2 MB| + +## References + +https://huggingface.co/harshuos/t5-base-v2_v18-edos_labelled_aggregated \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_base_v2_v18_edos_labelled_aggregated_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_base_v2_v18_edos_labelled_aggregated_pipeline_en.md new file mode 100644 index 00000000000000..61403f460fc509 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_base_v2_v18_edos_labelled_aggregated_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_v2_v18_edos_labelled_aggregated_pipeline pipeline T5Transformer from harshuos +author: John Snow Labs +name: t5_base_v2_v18_edos_labelled_aggregated_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_v2_v18_edos_labelled_aggregated_pipeline` is a English model originally trained by harshuos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_v2_v18_edos_labelled_aggregated_pipeline_en_5.4.2_3.0_1724301479973.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_v2_v18_edos_labelled_aggregated_pipeline_en_5.4.2_3.0_1724301479973.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_v2_v18_edos_labelled_aggregated_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_v2_v18_edos_labelled_aggregated_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_v2_v18_edos_labelled_aggregated_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|956.2 MB| + +## References + +https://huggingface.co/harshuos/t5-base-v2_v18-edos_labelled_aggregated + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_boolean_gen_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_boolean_gen_en.md new file mode 100644 index 00000000000000..af15e8e7c9e497 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_boolean_gen_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_boolean_gen T5Transformer from vishal2014 +author: John Snow Labs +name: t5_boolean_gen +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_boolean_gen` is a English model originally trained by vishal2014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_boolean_gen_en_5.4.2_3.0_1724350645756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_boolean_gen_en_5.4.2_3.0_1724350645756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_boolean_gen","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_boolean_gen", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_boolean_gen| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vishal2014/t5_boolean_gen \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_boolean_gen_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_boolean_gen_pipeline_en.md new file mode 100644 index 00000000000000..792adfb81021ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_boolean_gen_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_boolean_gen_pipeline pipeline T5Transformer from vishal2014 +author: John Snow Labs +name: t5_boolean_gen_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_boolean_gen_pipeline` is a English model originally trained by vishal2014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_boolean_gen_pipeline_en_5.4.2_3.0_1724350695939.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_boolean_gen_pipeline_en_5.4.2_3.0_1724350695939.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_boolean_gen_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_boolean_gen_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_boolean_gen_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/vishal2014/t5_boolean_gen + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_checkpoint_3_vietnamese_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_checkpoint_3_vietnamese_en.md new file mode 100644 index 00000000000000..b9c158792eddeb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_checkpoint_3_vietnamese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_checkpoint_3_vietnamese T5Transformer from nlplabtdtu +author: John Snow Labs +name: t5_checkpoint_3_vietnamese +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_checkpoint_3_vietnamese` is a English model originally trained by nlplabtdtu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_checkpoint_3_vietnamese_en_5.4.2_3.0_1724351026790.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_checkpoint_3_vietnamese_en_5.4.2_3.0_1724351026790.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_checkpoint_3_vietnamese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_checkpoint_3_vietnamese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_checkpoint_3_vietnamese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/nlplabtdtu/T5-checkpoint-3-vi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_checkpoint_3_vietnamese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_checkpoint_3_vietnamese_pipeline_en.md new file mode 100644 index 00000000000000..feeec051d1ecc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_checkpoint_3_vietnamese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_checkpoint_3_vietnamese_pipeline pipeline T5Transformer from nlplabtdtu +author: John Snow Labs +name: t5_checkpoint_3_vietnamese_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_checkpoint_3_vietnamese_pipeline` is a English model originally trained by nlplabtdtu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_checkpoint_3_vietnamese_pipeline_en_5.4.2_3.0_1724351175339.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_checkpoint_3_vietnamese_pipeline_en_5.4.2_3.0_1724351175339.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_checkpoint_3_vietnamese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_checkpoint_3_vietnamese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_checkpoint_3_vietnamese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/nlplabtdtu/T5-checkpoint-3-vi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_en.md new file mode 100644 index 00000000000000..12e3bf06039362 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10 T5Transformer from harish +author: John Snow Labs +name: t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10` is a English model originally trained by harish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_en_5.4.2_3.0_1724303114476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_en_5.4.2_3.0_1724303114476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|989.7 MB| + +## References + +https://huggingface.co/harish/t5-e2e-10epochs-lr1e4-alpha0-1PLUSalpha0-9-e10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline_en.md new file mode 100644 index 00000000000000..2d54e1fd4e05a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline pipeline T5Transformer from harish +author: John Snow Labs +name: t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline` is a English model originally trained by harish. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline_en_5.4.2_3.0_1724303167930.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline_en_5.4.2_3.0_1724303167930.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_e2e_10epochs_lr1e4_alpha0_1plusalpha0_9_e10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|989.7 MB| + +## References + +https://huggingface.co/harish/t5-e2e-10epochs-lr1e4-alpha0-1PLUSalpha0-9-e10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_e6_d70k_dim128_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_e6_d70k_dim128_en.md new file mode 100644 index 00000000000000..217ce46da2ba79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_e6_d70k_dim128_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_e6_d70k_dim128 T5Transformer from Kau-stuv +author: John Snow Labs +name: t5_e6_d70k_dim128 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_e6_d70k_dim128` is a English model originally trained by Kau-stuv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_e6_d70k_dim128_en_5.4.2_3.0_1724369469607.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_e6_d70k_dim128_en_5.4.2_3.0_1724369469607.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_e6_d70k_dim128","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_e6_d70k_dim128", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_e6_d70k_dim128| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.9 MB| + +## References + +https://huggingface.co/Kau-stuv/t5-e6-d70k-dim128 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_e6_d70k_dim128_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_e6_d70k_dim128_pipeline_en.md new file mode 100644 index 00000000000000..2752016fe9e4a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_e6_d70k_dim128_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_e6_d70k_dim128_pipeline pipeline T5Transformer from Kau-stuv +author: John Snow Labs +name: t5_e6_d70k_dim128_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_e6_d70k_dim128_pipeline` is a English model originally trained by Kau-stuv. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_e6_d70k_dim128_pipeline_en_5.4.2_3.0_1724369521614.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_e6_d70k_dim128_pipeline_en_5.4.2_3.0_1724369521614.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_e6_d70k_dim128_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_e6_d70k_dim128_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_e6_d70k_dim128_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|992.0 MB| + +## References + +https://huggingface.co/Kau-stuv/t5-e6-d70k-dim128 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_ep3_mscoco_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_ep3_mscoco_en.md new file mode 100644 index 00000000000000..5da2dd6e2aa40f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_ep3_mscoco_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_ep3_mscoco T5Transformer from jinujinu99 +author: John Snow Labs +name: t5_ep3_mscoco +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ep3_mscoco` is a English model originally trained by jinujinu99. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ep3_mscoco_en_5.4.2_3.0_1724327149237.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ep3_mscoco_en_5.4.2_3.0_1724327149237.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_ep3_mscoco","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_ep3_mscoco", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ep3_mscoco| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jinujinu99/t5-ep3-mscoco \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_ep3_mscoco_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_ep3_mscoco_pipeline_en.md new file mode 100644 index 00000000000000..46bcb02272a1c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_ep3_mscoco_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_ep3_mscoco_pipeline pipeline T5Transformer from jinujinu99 +author: John Snow Labs +name: t5_ep3_mscoco_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ep3_mscoco_pipeline` is a English model originally trained by jinujinu99. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ep3_mscoco_pipeline_en_5.4.2_3.0_1724327196819.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ep3_mscoco_pipeline_en_5.4.2_3.0_1724327196819.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_ep3_mscoco_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_ep3_mscoco_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ep3_mscoco_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jinujinu99/t5-ep3-mscoco + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_ep6_parabk2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_ep6_parabk2_en.md new file mode 100644 index 00000000000000..c522186dfe4aa0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_ep6_parabk2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_ep6_parabk2 T5Transformer from jinujinu99 +author: John Snow Labs +name: t5_ep6_parabk2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ep6_parabk2` is a English model originally trained by jinujinu99. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ep6_parabk2_en_5.4.2_3.0_1724313757531.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ep6_parabk2_en_5.4.2_3.0_1724313757531.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_ep6_parabk2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_ep6_parabk2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ep6_parabk2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jinujinu99/t5-ep6-parabk2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_ep6_parabk2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_ep6_parabk2_pipeline_en.md new file mode 100644 index 00000000000000..fbdbcb78e356a2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_ep6_parabk2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_ep6_parabk2_pipeline pipeline T5Transformer from jinujinu99 +author: John Snow Labs +name: t5_ep6_parabk2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_ep6_parabk2_pipeline` is a English model originally trained by jinujinu99. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_ep6_parabk2_pipeline_en_5.4.2_3.0_1724313812057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_ep6_parabk2_pipeline_en_5.4.2_3.0_1724313812057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_ep6_parabk2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_ep6_parabk2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_ep6_parabk2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/jinujinu99/t5-ep6-parabk2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_fin_large_common_sense_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_fin_large_common_sense_en.md new file mode 100644 index 00000000000000..4e235484aca087 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_fin_large_common_sense_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_fin_large_common_sense T5Transformer from guyhadad01 +author: John Snow Labs +name: t5_fin_large_common_sense +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fin_large_common_sense` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fin_large_common_sense_en_5.4.2_3.0_1724353490596.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fin_large_common_sense_en_5.4.2_3.0_1724353490596.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_fin_large_common_sense","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_fin_large_common_sense", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fin_large_common_sense| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/guyhadad01/t5-fin-large-common-sense \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_fin_large_common_sense_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_fin_large_common_sense_pipeline_en.md new file mode 100644 index 00000000000000..619bfcd152926f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_fin_large_common_sense_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_fin_large_common_sense_pipeline pipeline T5Transformer from guyhadad01 +author: John Snow Labs +name: t5_fin_large_common_sense_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_fin_large_common_sense_pipeline` is a English model originally trained by guyhadad01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_fin_large_common_sense_pipeline_en_5.4.2_3.0_1724353631984.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_fin_large_common_sense_pipeline_en_5.4.2_3.0_1724353631984.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_fin_large_common_sense_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_fin_large_common_sense_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_fin_large_common_sense_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/guyhadad01/t5-fin-large-common-sense + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_finetune_cnndaily_news_sumsum_convanalysis_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_finetune_cnndaily_news_sumsum_convanalysis_en.md new file mode 100644 index 00000000000000..1a3673533c8504 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_finetune_cnndaily_news_sumsum_convanalysis_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetune_cnndaily_news_sumsum_convanalysis T5Transformer from ConvAnalysis +author: John Snow Labs +name: t5_finetune_cnndaily_news_sumsum_convanalysis +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetune_cnndaily_news_sumsum_convanalysis` is a English model originally trained by ConvAnalysis. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetune_cnndaily_news_sumsum_convanalysis_en_5.4.2_3.0_1724301190934.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetune_cnndaily_news_sumsum_convanalysis_en_5.4.2_3.0_1724301190934.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetune_cnndaily_news_sumsum_convanalysis","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetune_cnndaily_news_sumsum_convanalysis", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetune_cnndaily_news_sumsum_convanalysis| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/ConvAnalysis/t5-finetune-cnndaily-news-sumsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline_en.md new file mode 100644 index 00000000000000..edcfc3fc0e5a7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline pipeline T5Transformer from ConvAnalysis +author: John Snow Labs +name: t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline` is a English model originally trained by ConvAnalysis. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline_en_5.4.2_3.0_1724301208432.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline_en_5.4.2_3.0_1724301208432.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetune_cnndaily_news_sumsum_convanalysis_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/ConvAnalysis/t5-finetune-cnndaily-news-sumsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_emea_20k_english_german_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_emea_20k_english_german_en.md new file mode 100644 index 00000000000000..e28c7a8ff035e6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_emea_20k_english_german_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetuned_emea_20k_english_german T5Transformer from muibk +author: John Snow Labs +name: t5_finetuned_emea_20k_english_german +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_emea_20k_english_german` is a English model originally trained by muibk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_emea_20k_english_german_en_5.4.2_3.0_1724307254647.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_emea_20k_english_german_en_5.4.2_3.0_1724307254647.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetuned_emea_20k_english_german","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetuned_emea_20k_english_german", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_emea_20k_english_german| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|319.5 MB| + +## References + +https://huggingface.co/muibk/t5_finetuned_emea_20k_en-de \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_emea_20k_english_german_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_emea_20k_english_german_pipeline_en.md new file mode 100644 index 00000000000000..77505919c08f2f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_emea_20k_english_german_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetuned_emea_20k_english_german_pipeline pipeline T5Transformer from muibk +author: John Snow Labs +name: t5_finetuned_emea_20k_english_german_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_emea_20k_english_german_pipeline` is a English model originally trained by muibk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_emea_20k_english_german_pipeline_en_5.4.2_3.0_1724307274523.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_emea_20k_english_german_pipeline_en_5.4.2_3.0_1724307274523.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetuned_emea_20k_english_german_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetuned_emea_20k_english_german_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_emea_20k_english_german_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|319.5 MB| + +## References + +https://huggingface.co/muibk/t5_finetuned_emea_20k_en-de + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_for_gec_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_for_gec_en.md new file mode 100644 index 00000000000000..225c482707c8a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_for_gec_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetuned_for_gec T5Transformer from shashank2123 +author: John Snow Labs +name: t5_finetuned_for_gec +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_for_gec` is a English model originally trained by shashank2123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_for_gec_en_5.4.2_3.0_1724333694945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_for_gec_en_5.4.2_3.0_1724333694945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetuned_for_gec","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetuned_for_gec", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_for_gec| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/shashank2123/t5-finetuned-for-GEC \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_for_gec_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_for_gec_pipeline_en.md new file mode 100644 index 00000000000000..7881d82b96dc65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_for_gec_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetuned_for_gec_pipeline pipeline T5Transformer from shashank2123 +author: John Snow Labs +name: t5_finetuned_for_gec_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_for_gec_pipeline` is a English model originally trained by shashank2123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_for_gec_pipeline_en_5.4.2_3.0_1724333743779.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_for_gec_pipeline_en_5.4.2_3.0_1724333743779.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetuned_for_gec_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetuned_for_gec_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_for_gec_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/shashank2123/t5-finetuned-for-GEC + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_gentextsim_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_gentextsim_en.md new file mode 100644 index 00000000000000..f0ae664b0f9c28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_gentextsim_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_finetuned_gentextsim T5Transformer from nc33 +author: John Snow Labs +name: t5_finetuned_gentextsim +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_gentextsim` is a English model originally trained by nc33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_gentextsim_en_5.4.2_3.0_1724346420733.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_gentextsim_en_5.4.2_3.0_1724346420733.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_finetuned_gentextsim","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_finetuned_gentextsim", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_gentextsim| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|916.6 MB| + +## References + +https://huggingface.co/nc33/t5_finetuned_gentextSIM \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_gentextsim_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_gentextsim_pipeline_en.md new file mode 100644 index 00000000000000..98138a499b31fa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_finetuned_gentextsim_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_finetuned_gentextsim_pipeline pipeline T5Transformer from nc33 +author: John Snow Labs +name: t5_finetuned_gentextsim_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_finetuned_gentextsim_pipeline` is a English model originally trained by nc33. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_finetuned_gentextsim_pipeline_en_5.4.2_3.0_1724346479227.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_finetuned_gentextsim_pipeline_en_5.4.2_3.0_1724346479227.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_finetuned_gentextsim_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_finetuned_gentextsim_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_finetuned_gentextsim_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|916.6 MB| + +## References + +https://huggingface.co/nc33/t5_finetuned_gentextSIM + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_gec_6_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_gec_6_en.md new file mode 100644 index 00000000000000..74a3e175b4155e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_gec_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_gec_6 T5Transformer from anujraymajhi +author: John Snow Labs +name: t5_gec_6 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_gec_6` is a English model originally trained by anujraymajhi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_gec_6_en_5.4.2_3.0_1724321039572.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_gec_6_en_5.4.2_3.0_1724321039572.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_gec_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_gec_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_gec_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|988.7 MB| + +## References + +https://huggingface.co/anujraymajhi/t5-GEC-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_gec_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_gec_6_pipeline_en.md new file mode 100644 index 00000000000000..4ef956106e1aaa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_gec_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_gec_6_pipeline pipeline T5Transformer from anujraymajhi +author: John Snow Labs +name: t5_gec_6_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_gec_6_pipeline` is a English model originally trained by anujraymajhi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_gec_6_pipeline_en_5.4.2_3.0_1724321094898.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_gec_6_pipeline_en_5.4.2_3.0_1724321094898.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_gec_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_gec_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_gec_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|988.7 MB| + +## References + +https://huggingface.co/anujraymajhi/t5-GEC-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_gec_english_125k_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_gec_english_125k_en.md new file mode 100644 index 00000000000000..0d0f9190402f74 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_gec_english_125k_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_gec_english_125k T5Transformer from devanshipatel +author: John Snow Labs +name: t5_gec_english_125k +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_gec_english_125k` is a English model originally trained by devanshipatel. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_gec_english_125k_en_5.4.2_3.0_1724296563150.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_gec_english_125k_en_5.4.2_3.0_1724296563150.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_gec_english_125k","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_gec_english_125k", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_gec_english_125k| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|994.0 MB| + +## References + +https://huggingface.co/devanshipatel/t5-gec-english-125k \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_gec_english_125k_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_gec_english_125k_pipeline_en.md new file mode 100644 index 00000000000000..6b0f2176d1c67d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_gec_english_125k_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_gec_english_125k_pipeline pipeline T5Transformer from devanshipatel +author: John Snow Labs +name: t5_gec_english_125k_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_gec_english_125k_pipeline` is a English model originally trained by devanshipatel. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_gec_english_125k_pipeline_en_5.4.2_3.0_1724296613629.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_gec_english_125k_pipeline_en_5.4.2_3.0_1724296613629.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_gec_english_125k_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_gec_english_125k_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_gec_english_125k_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|994.0 MB| + +## References + +https://huggingface.co/devanshipatel/t5-gec-english-125k + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_grammar_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_grammar_v1_en.md new file mode 100644 index 00000000000000..dc9ae31924b6c7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_grammar_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_grammar_v1 T5Transformer from gopinathk-llm +author: John Snow Labs +name: t5_grammar_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_grammar_v1` is a English model originally trained by gopinathk-llm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_grammar_v1_en_5.4.2_3.0_1724361906928.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_grammar_v1_en_5.4.2_3.0_1724361906928.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_grammar_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_grammar_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_grammar_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|952.6 MB| + +## References + +https://huggingface.co/gopinathk-llm/t5-grammar-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_grammar_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_grammar_v1_pipeline_en.md new file mode 100644 index 00000000000000..24df3a96409e69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_grammar_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_grammar_v1_pipeline pipeline T5Transformer from gopinathk-llm +author: John Snow Labs +name: t5_grammar_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_grammar_v1_pipeline` is a English model originally trained by gopinathk-llm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_grammar_v1_pipeline_en_5.4.2_3.0_1724361976729.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_grammar_v1_pipeline_en_5.4.2_3.0_1724361976729.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_grammar_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_grammar_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_grammar_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|952.6 MB| + +## References + +https://huggingface.co/gopinathk-llm/t5-grammar-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_large_dataset_radiology_20220912_tsv_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_large_dataset_radiology_20220912_tsv_en.md new file mode 100644 index 00000000000000..dba79aae8b5d33 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_large_dataset_radiology_20220912_tsv_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_dataset_radiology_20220912_tsv T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_dataset_radiology_20220912_tsv +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_dataset_radiology_20220912_tsv` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_dataset_radiology_20220912_tsv_en_5.4.2_3.0_1724337170672.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_dataset_radiology_20220912_tsv_en_5.4.2_3.0_1724337170672.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_dataset_radiology_20220912_tsv","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_dataset_radiology_20220912_tsv", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_dataset_radiology_20220912_tsv| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_dataset_radiology_20220912.tsv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_large_dataset_radiology_20220912_tsv_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_large_dataset_radiology_20220912_tsv_pipeline_en.md new file mode 100644 index 00000000000000..d717af0ce5fb3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_large_dataset_radiology_20220912_tsv_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_dataset_radiology_20220912_tsv_pipeline pipeline T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_dataset_radiology_20220912_tsv_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_dataset_radiology_20220912_tsv_pipeline` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_dataset_radiology_20220912_tsv_pipeline_en_5.4.2_3.0_1724337349249.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_dataset_radiology_20220912_tsv_pipeline_en_5.4.2_3.0_1724337349249.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_dataset_radiology_20220912_tsv_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_dataset_radiology_20220912_tsv_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_dataset_radiology_20220912_tsv_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_dataset_radiology_20220912.tsv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_large_tweetqa_qa_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_large_tweetqa_qa_en.md new file mode 100644 index 00000000000000..94d0546ee9d40f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_large_tweetqa_qa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_tweetqa_qa T5Transformer from lmqg +author: John Snow Labs +name: t5_large_tweetqa_qa +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_tweetqa_qa` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_tweetqa_qa_en_5.4.2_3.0_1724320286514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_tweetqa_qa_en_5.4.2_3.0_1724320286514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_tweetqa_qa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_tweetqa_qa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_tweetqa_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/lmqg/t5-large-tweetqa-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_large_tweetqa_qa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_large_tweetqa_qa_pipeline_en.md new file mode 100644 index 00000000000000..cda87aea4eae46 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_large_tweetqa_qa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_tweetqa_qa_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: t5_large_tweetqa_qa_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_tweetqa_qa_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_tweetqa_qa_pipeline_en_5.4.2_3.0_1724320425322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_tweetqa_qa_pipeline_en_5.4.2_3.0_1724320425322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_tweetqa_qa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_tweetqa_qa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_tweetqa_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/lmqg/t5-large-tweetqa-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_length_commands_tonga_tonga_islands_actions_5_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_length_commands_tonga_tonga_islands_actions_5_en.md new file mode 100644 index 00000000000000..c786ea53f5325d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_length_commands_tonga_tonga_islands_actions_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_length_commands_tonga_tonga_islands_actions_5 T5Transformer from LadyShizu +author: John Snow Labs +name: t5_length_commands_tonga_tonga_islands_actions_5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_length_commands_tonga_tonga_islands_actions_5` is a English model originally trained by LadyShizu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_length_commands_tonga_tonga_islands_actions_5_en_5.4.2_3.0_1724344361433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_length_commands_tonga_tonga_islands_actions_5_en_5.4.2_3.0_1724344361433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_length_commands_tonga_tonga_islands_actions_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_length_commands_tonga_tonga_islands_actions_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_length_commands_tonga_tonga_islands_actions_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LadyShizu/T5_length-commands_to_actions_5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_length_commands_tonga_tonga_islands_actions_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_length_commands_tonga_tonga_islands_actions_5_pipeline_en.md new file mode 100644 index 00000000000000..c4c99955267785 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_length_commands_tonga_tonga_islands_actions_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_length_commands_tonga_tonga_islands_actions_5_pipeline pipeline T5Transformer from LadyShizu +author: John Snow Labs +name: t5_length_commands_tonga_tonga_islands_actions_5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_length_commands_tonga_tonga_islands_actions_5_pipeline` is a English model originally trained by LadyShizu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_length_commands_tonga_tonga_islands_actions_5_pipeline_en_5.4.2_3.0_1724344417536.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_length_commands_tonga_tonga_islands_actions_5_pipeline_en_5.4.2_3.0_1724344417536.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_length_commands_tonga_tonga_islands_actions_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_length_commands_tonga_tonga_islands_actions_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_length_commands_tonga_tonga_islands_actions_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LadyShizu/T5_length-commands_to_actions_5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_lyrics_summarizer_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_lyrics_summarizer_en.md new file mode 100644 index 00000000000000..d2ee039700e31a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_lyrics_summarizer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_lyrics_summarizer T5Transformer from samirpsalim +author: John Snow Labs +name: t5_lyrics_summarizer +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_lyrics_summarizer` is a English model originally trained by samirpsalim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_lyrics_summarizer_en_5.4.2_3.0_1724333610366.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_lyrics_summarizer_en_5.4.2_3.0_1724333610366.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_lyrics_summarizer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_lyrics_summarizer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_lyrics_summarizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/samirpsalim/t5-lyrics-summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_lyrics_summarizer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_lyrics_summarizer_pipeline_en.md new file mode 100644 index 00000000000000..2deb68edc01165 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_lyrics_summarizer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_lyrics_summarizer_pipeline pipeline T5Transformer from samirpsalim +author: John Snow Labs +name: t5_lyrics_summarizer_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_lyrics_summarizer_pipeline` is a English model originally trained by samirpsalim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_lyrics_summarizer_pipeline_en_5.4.2_3.0_1724333628132.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_lyrics_summarizer_pipeline_en_5.4.2_3.0_1724333628132.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_lyrics_summarizer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_lyrics_summarizer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_lyrics_summarizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|347.3 MB| + +## References + +https://huggingface.co/samirpsalim/t5-lyrics-summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_many_tonga_tonga_islands_eng_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_many_tonga_tonga_islands_eng_en.md new file mode 100644 index 00000000000000..fe39320d245c20 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_many_tonga_tonga_islands_eng_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_many_tonga_tonga_islands_eng T5Transformer from jq +author: John Snow Labs +name: t5_many_tonga_tonga_islands_eng +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_many_tonga_tonga_islands_eng` is a English model originally trained by jq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_many_tonga_tonga_islands_eng_en_5.4.2_3.0_1724362290483.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_many_tonga_tonga_islands_eng_en_5.4.2_3.0_1724362290483.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_many_tonga_tonga_islands_eng","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_many_tonga_tonga_islands_eng", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_many_tonga_tonga_islands_eng| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/jq/t5-many-to-eng \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_many_tonga_tonga_islands_eng_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_many_tonga_tonga_islands_eng_pipeline_en.md new file mode 100644 index 00000000000000..f5fe31854391fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_many_tonga_tonga_islands_eng_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_many_tonga_tonga_islands_eng_pipeline pipeline T5Transformer from jq +author: John Snow Labs +name: t5_many_tonga_tonga_islands_eng_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_many_tonga_tonga_islands_eng_pipeline` is a English model originally trained by jq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_many_tonga_tonga_islands_eng_pipeline_en_5.4.2_3.0_1724362311099.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_many_tonga_tonga_islands_eng_pipeline_en_5.4.2_3.0_1724362311099.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_many_tonga_tonga_islands_eng_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_many_tonga_tonga_islands_eng_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_many_tonga_tonga_islands_eng_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.0 MB| + +## References + +https://huggingface.co/jq/t5-many-to-eng + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_model_1_feedback_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_model_1_feedback_en.md new file mode 100644 index 00000000000000..40250b95345a71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_model_1_feedback_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_1_feedback T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_feedback +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_feedback` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_en_5.4.2_3.0_1724311825302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_en_5.4.2_3.0_1724311825302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_1_feedback","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_1_feedback", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_feedback| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|965.0 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-feedback \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_model_1_feedback_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_model_1_feedback_pipeline_en.md new file mode 100644 index 00000000000000..df4253ef0628a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_model_1_feedback_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_1_feedback_pipeline pipeline T5Transformer from theojolliffe +author: John Snow Labs +name: t5_model_1_feedback_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_1_feedback_pipeline` is a English model originally trained by theojolliffe. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_pipeline_en_5.4.2_3.0_1724311874772.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_1_feedback_pipeline_en_5.4.2_3.0_1724311874772.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_1_feedback_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_1_feedback_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_1_feedback_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|965.0 MB| + +## References + +https://huggingface.co/theojolliffe/T5-model-1-feedback + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_model_akhilsplendid_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_model_akhilsplendid_en.md new file mode 100644 index 00000000000000..ce3f7ee2ccaca4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_model_akhilsplendid_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_model_akhilsplendid T5Transformer from Akhilsplendid +author: John Snow Labs +name: t5_model_akhilsplendid +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_akhilsplendid` is a English model originally trained by Akhilsplendid. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_akhilsplendid_en_5.4.2_3.0_1724315981353.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_akhilsplendid_en_5.4.2_3.0_1724315981353.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_model_akhilsplendid","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_model_akhilsplendid", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_akhilsplendid| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Akhilsplendid/T5-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_model_akhilsplendid_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_model_akhilsplendid_pipeline_en.md new file mode 100644 index 00000000000000..bb86f4e77a3f61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_model_akhilsplendid_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_model_akhilsplendid_pipeline pipeline T5Transformer from Akhilsplendid +author: John Snow Labs +name: t5_model_akhilsplendid_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_model_akhilsplendid_pipeline` is a English model originally trained by Akhilsplendid. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_model_akhilsplendid_pipeline_en_5.4.2_3.0_1724316033494.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_model_akhilsplendid_pipeline_en_5.4.2_3.0_1724316033494.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_model_akhilsplendid_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_model_akhilsplendid_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_model_akhilsplendid_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Akhilsplendid/T5-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_pretrain_wikipedia_sample_final_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_pretrain_wikipedia_sample_final_en.md new file mode 100644 index 00000000000000..0906647a653462 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_pretrain_wikipedia_sample_final_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_pretrain_wikipedia_sample_final T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_pretrain_wikipedia_sample_final +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pretrain_wikipedia_sample_final` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pretrain_wikipedia_sample_final_en_5.4.2_3.0_1724370686623.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pretrain_wikipedia_sample_final_en_5.4.2_3.0_1724370686623.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_pretrain_wikipedia_sample_final","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_pretrain_wikipedia_sample_final", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pretrain_wikipedia_sample_final| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5-pretrain-wikipedia-sample-final \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_pretrain_wikipedia_sample_final_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_pretrain_wikipedia_sample_final_pipeline_en.md new file mode 100644 index 00000000000000..17a8104ed4fa8b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_pretrain_wikipedia_sample_final_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_pretrain_wikipedia_sample_final_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_pretrain_wikipedia_sample_final_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pretrain_wikipedia_sample_final_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pretrain_wikipedia_sample_final_pipeline_en_5.4.2_3.0_1724370703936.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pretrain_wikipedia_sample_final_pipeline_en_5.4.2_3.0_1724370703936.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_pretrain_wikipedia_sample_final_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_pretrain_wikipedia_sample_final_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pretrain_wikipedia_sample_final_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.6 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5-pretrain-wikipedia-sample-final + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_pubmedqa_question_generation_pretrained_medquad_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_pubmedqa_question_generation_pretrained_medquad_en.md new file mode 100644 index 00000000000000..fcc3e42380779e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_pubmedqa_question_generation_pretrained_medquad_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_pubmedqa_question_generation_pretrained_medquad T5Transformer from frozenwalker +author: John Snow Labs +name: t5_pubmedqa_question_generation_pretrained_medquad +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pubmedqa_question_generation_pretrained_medquad` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pubmedqa_question_generation_pretrained_medquad_en_5.4.2_3.0_1724367015376.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pubmedqa_question_generation_pretrained_medquad_en_5.4.2_3.0_1724367015376.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_pubmedqa_question_generation_pretrained_medquad","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_pubmedqa_question_generation_pretrained_medquad", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pubmedqa_question_generation_pretrained_medquad| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/T5_pubmedqa_question_generation_preTrained_MedQuad \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_pubmedqa_question_generation_pretrained_medquad_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_pubmedqa_question_generation_pretrained_medquad_pipeline_en.md new file mode 100644 index 00000000000000..ccf19591378839 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_pubmedqa_question_generation_pretrained_medquad_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_pubmedqa_question_generation_pretrained_medquad_pipeline pipeline T5Transformer from frozenwalker +author: John Snow Labs +name: t5_pubmedqa_question_generation_pretrained_medquad_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_pubmedqa_question_generation_pretrained_medquad_pipeline` is a English model originally trained by frozenwalker. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_pubmedqa_question_generation_pretrained_medquad_pipeline_en_5.4.2_3.0_1724367061560.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_pubmedqa_question_generation_pretrained_medquad_pipeline_en_5.4.2_3.0_1724367061560.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_pubmedqa_question_generation_pretrained_medquad_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_pubmedqa_question_generation_pretrained_medquad_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_pubmedqa_question_generation_pretrained_medquad_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/frozenwalker/T5_pubmedqa_question_generation_preTrained_MedQuad + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_recommendation_sports_equipment_english_ishazi_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_recommendation_sports_equipment_english_ishazi_en.md new file mode 100644 index 00000000000000..4efc66c2933530 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_recommendation_sports_equipment_english_ishazi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_ishazi T5Transformer from ishazi +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_ishazi +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_ishazi` is a English model originally trained by ishazi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_ishazi_en_5.4.2_3.0_1724325148721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_ishazi_en_5.4.2_3.0_1724325148721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_ishazi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_recommendation_sports_equipment_english_ishazi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_ishazi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/ishazi/t5_recommendation_sports_equipment_english \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_recommendation_sports_equipment_english_ishazi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_recommendation_sports_equipment_english_ishazi_pipeline_en.md new file mode 100644 index 00000000000000..0ef41cd6617548 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_recommendation_sports_equipment_english_ishazi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_recommendation_sports_equipment_english_ishazi_pipeline pipeline T5Transformer from ishazi +author: John Snow Labs +name: t5_recommendation_sports_equipment_english_ishazi_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_recommendation_sports_equipment_english_ishazi_pipeline` is a English model originally trained by ishazi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_ishazi_pipeline_en_5.4.2_3.0_1724325365050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_recommendation_sports_equipment_english_ishazi_pipeline_en_5.4.2_3.0_1724325365050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_recommendation_sports_equipment_english_ishazi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_recommendation_sports_equipment_english_ishazi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_recommendation_sports_equipment_english_ishazi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/ishazi/t5_recommendation_sports_equipment_english + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_samsum_omarharoon01_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_samsum_omarharoon01_en.md new file mode 100644 index 00000000000000..5fda1f02878416 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_samsum_omarharoon01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_samsum_omarharoon01 T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_samsum_omarharoon01 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_samsum_omarharoon01` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_samsum_omarharoon01_en_5.4.2_3.0_1724303751609.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_samsum_omarharoon01_en_5.4.2_3.0_1724303751609.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_samsum_omarharoon01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_samsum_omarharoon01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_samsum_omarharoon01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.6 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_samsum_omarharoon01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_samsum_omarharoon01_pipeline_en.md new file mode 100644 index 00000000000000..ba8f3af8f7f6e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_samsum_omarharoon01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_samsum_omarharoon01_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_samsum_omarharoon01_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_samsum_omarharoon01_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_samsum_omarharoon01_pipeline_en_5.4.2_3.0_1724303770324.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_samsum_omarharoon01_pipeline_en_5.4.2_3.0_1724303770324.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_samsum_omarharoon01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_samsum_omarharoon01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_samsum_omarharoon01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.6 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_simple_commands_tonga_tonga_islands_actions_5_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_simple_commands_tonga_tonga_islands_actions_5_en.md new file mode 100644 index 00000000000000..97119ad4a0c112 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_simple_commands_tonga_tonga_islands_actions_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_simple_commands_tonga_tonga_islands_actions_5 T5Transformer from LadyShizu +author: John Snow Labs +name: t5_simple_commands_tonga_tonga_islands_actions_5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_simple_commands_tonga_tonga_islands_actions_5` is a English model originally trained by LadyShizu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_simple_commands_tonga_tonga_islands_actions_5_en_5.4.2_3.0_1724316531050.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_simple_commands_tonga_tonga_islands_actions_5_en_5.4.2_3.0_1724316531050.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_simple_commands_tonga_tonga_islands_actions_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_simple_commands_tonga_tonga_islands_actions_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_simple_commands_tonga_tonga_islands_actions_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LadyShizu/T5_simple-commands_to_actions_5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_simple_commands_tonga_tonga_islands_actions_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_simple_commands_tonga_tonga_islands_actions_5_pipeline_en.md new file mode 100644 index 00000000000000..7b5faf182f839b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_simple_commands_tonga_tonga_islands_actions_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_simple_commands_tonga_tonga_islands_actions_5_pipeline pipeline T5Transformer from LadyShizu +author: John Snow Labs +name: t5_simple_commands_tonga_tonga_islands_actions_5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_simple_commands_tonga_tonga_islands_actions_5_pipeline` is a English model originally trained by LadyShizu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_simple_commands_tonga_tonga_islands_actions_5_pipeline_en_5.4.2_3.0_1724316577534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_simple_commands_tonga_tonga_islands_actions_5_pipeline_en_5.4.2_3.0_1724316577534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_simple_commands_tonga_tonga_islands_actions_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_simple_commands_tonga_tonga_islands_actions_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_simple_commands_tonga_tonga_islands_actions_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/LadyShizu/T5_simple-commands_to_actions_5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_chit_chat_conv_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_chit_chat_conv_en.md new file mode 100644 index 00000000000000..eeb8be68752856 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_chit_chat_conv_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_chit_chat_conv T5Transformer from madhavappaneni +author: John Snow Labs +name: t5_small_chit_chat_conv +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_chit_chat_conv` is a English model originally trained by madhavappaneni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_chit_chat_conv_en_5.4.2_3.0_1724348863142.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_chit_chat_conv_en_5.4.2_3.0_1724348863142.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_chit_chat_conv","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_chit_chat_conv", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_chit_chat_conv| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.4 MB| + +## References + +https://huggingface.co/madhavappaneni/t5-small-chit-chat-conv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_chit_chat_conv_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_chit_chat_conv_pipeline_en.md new file mode 100644 index 00000000000000..5eb923cb247b7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_chit_chat_conv_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_chit_chat_conv_pipeline pipeline T5Transformer from madhavappaneni +author: John Snow Labs +name: t5_small_chit_chat_conv_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_chit_chat_conv_pipeline` is a English model originally trained by madhavappaneni. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_chit_chat_conv_pipeline_en_5.4.2_3.0_1724348879427.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_chit_chat_conv_pipeline_en_5.4.2_3.0_1724348879427.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_chit_chat_conv_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_chit_chat_conv_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_chit_chat_conv_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.4 MB| + +## References + +https://huggingface.co/madhavappaneni/t5-small-chit-chat-conv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_128_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_128_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..323603fbf40f06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_128_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_128_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_128_finetuned_squad_seed_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_128_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_128_finetuned_squad_seed_2_en_5.4.2_3.0_1724317508794.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_128_finetuned_squad_seed_2_en_5.4.2_3.0_1724317508794.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_128_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_128_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_128_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-128-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..8a75ca69e8bc17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724317538267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724317538267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_128_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-128-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_256_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_256_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..20b10a8eebc08a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_256_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_256_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_256_finetuned_squad_seed_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_256_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_256_finetuned_squad_seed_2_en_5.4.2_3.0_1724288172988.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_256_finetuned_squad_seed_2_en_5.4.2_3.0_1724288172988.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_256_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_256_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_256_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|307.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-256-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..5c46688737c016 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724288199492.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724288199492.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_256_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|307.7 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-256-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetune_imdb_main_model_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetune_imdb_main_model_en.md new file mode 100644 index 00000000000000..66ca46ec583b2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetune_imdb_main_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetune_imdb_main_model T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_small_finetune_imdb_main_model +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetune_imdb_main_model` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetune_imdb_main_model_en_5.4.2_3.0_1724343596660.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetune_imdb_main_model_en_5.4.2_3.0_1724343596660.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetune_imdb_main_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetune_imdb_main_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetune_imdb_main_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.4 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5_small_finetune_IMDB_main_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetune_imdb_main_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetune_imdb_main_model_pipeline_en.md new file mode 100644 index 00000000000000..7422ee7be246c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetune_imdb_main_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetune_imdb_main_model_pipeline pipeline T5Transformer from OmarHaroon01 +author: John Snow Labs +name: t5_small_finetune_imdb_main_model_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetune_imdb_main_model_pipeline` is a English model originally trained by OmarHaroon01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetune_imdb_main_model_pipeline_en_5.4.2_3.0_1724343622964.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetune_imdb_main_model_pipeline_en_5.4.2_3.0_1724343622964.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetune_imdb_main_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetune_imdb_main_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetune_imdb_main_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.4 MB| + +## References + +https://huggingface.co/OmarHaroon01/t5_small_finetune_IMDB_main_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned2_en.md new file mode 100644 index 00000000000000..29d5dc1f4eea66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned2 T5Transformer from HARDYCHEN +author: John Snow Labs +name: t5_small_finetuned2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned2` is a English model originally trained by HARDYCHEN. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned2_en_5.4.2_3.0_1724338667722.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned2_en_5.4.2_3.0_1724338667722.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|334.8 MB| + +## References + +https://huggingface.co/HARDYCHEN/t5-small_finetuned2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned2_pipeline_en.md new file mode 100644 index 00000000000000..9f37a597f40b73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned2_pipeline pipeline T5Transformer from HARDYCHEN +author: John Snow Labs +name: t5_small_finetuned2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned2_pipeline` is a English model originally trained by HARDYCHEN. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned2_pipeline_en_5.4.2_3.0_1724338687062.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned2_pipeline_en_5.4.2_3.0_1724338687062.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|334.8 MB| + +## References + +https://huggingface.co/HARDYCHEN/t5-small_finetuned2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_01_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_01_en.md new file mode 100644 index 00000000000000..178611e544e948 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_01_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_2024_04_01 T5Transformer from liamvbetts +author: John Snow Labs +name: t5_small_finetuned_2024_04_01 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_2024_04_01` is a English model originally trained by liamvbetts. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_01_en_5.4.2_3.0_1724330976975.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_01_en_5.4.2_3.0_1724330976975.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_2024_04_01","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_2024_04_01", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_2024_04_01| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.9 MB| + +## References + +https://huggingface.co/liamvbetts/t5-small-finetuned-2024-04-01 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_01_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_01_pipeline_en.md new file mode 100644 index 00000000000000..074580e98a0212 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_01_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_2024_04_01_pipeline pipeline T5Transformer from liamvbetts +author: John Snow Labs +name: t5_small_finetuned_2024_04_01_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_2024_04_01_pipeline` is a English model originally trained by liamvbetts. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_01_pipeline_en_5.4.2_3.0_1724330995083.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_01_pipeline_en_5.4.2_3.0_1724330995083.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_2024_04_01_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_2024_04_01_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_2024_04_01_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.9 MB| + +## References + +https://huggingface.co/liamvbetts/t5-small-finetuned-2024-04-01 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_04_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_04_en.md new file mode 100644 index 00000000000000..965d215b68faab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_04_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_2024_04_04 T5Transformer from liamvbetts +author: John Snow Labs +name: t5_small_finetuned_2024_04_04 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_2024_04_04` is a English model originally trained by liamvbetts. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_04_en_5.4.2_3.0_1724346192367.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_04_en_5.4.2_3.0_1724346192367.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_2024_04_04","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_2024_04_04", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_2024_04_04| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|343.2 MB| + +## References + +https://huggingface.co/liamvbetts/t5-small-finetuned-2024-04-04 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_04_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_04_pipeline_en.md new file mode 100644 index 00000000000000..1961ca5aee491a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_2024_04_04_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_2024_04_04_pipeline pipeline T5Transformer from liamvbetts +author: John Snow Labs +name: t5_small_finetuned_2024_04_04_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_2024_04_04_pipeline` is a English model originally trained by liamvbetts. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_04_pipeline_en_5.4.2_3.0_1724346210599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_2024_04_04_pipeline_en_5.4.2_3.0_1724346210599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_2024_04_04_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_2024_04_04_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_2024_04_04_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|343.2 MB| + +## References + +https://huggingface.co/liamvbetts/t5-small-finetuned-2024-04-04 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_coding_instructions_2023_08_18__08_41_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_coding_instructions_2023_08_18__08_41_en.md new file mode 100644 index 00000000000000..26a39d767b395e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_coding_instructions_2023_08_18__08_41_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_coding_instructions_2023_08_18__08_41 T5Transformer from jerome1519 +author: John Snow Labs +name: t5_small_finetuned_coding_instructions_2023_08_18__08_41 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_coding_instructions_2023_08_18__08_41` is a English model originally trained by jerome1519. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_coding_instructions_2023_08_18__08_41_en_5.4.2_3.0_1724344722525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_coding_instructions_2023_08_18__08_41_en_5.4.2_3.0_1724344722525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_coding_instructions_2023_08_18__08_41","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_coding_instructions_2023_08_18__08_41", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_coding_instructions_2023_08_18__08_41| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|280.5 MB| + +## References + +https://huggingface.co/jerome1519/t5-small-finetuned-coding_instructions_2023_08_18__08_41 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline_en.md new file mode 100644 index 00000000000000..f858727e2eb89f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline pipeline T5Transformer from jerome1519 +author: John Snow Labs +name: t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline` is a English model originally trained by jerome1519. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline_en_5.4.2_3.0_1724344746569.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline_en_5.4.2_3.0_1724344746569.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_coding_instructions_2023_08_18__08_41_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|280.5 MB| + +## References + +https://huggingface.co/jerome1519/t5-small-finetuned-coding_instructions_2023_08_18__08_41 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_eli5_bkim12_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_eli5_bkim12_en.md new file mode 100644 index 00000000000000..7ae880c5941f3e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_eli5_bkim12_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_eli5_bkim12 T5Transformer from bkim12 +author: John Snow Labs +name: t5_small_finetuned_eli5_bkim12 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_eli5_bkim12` is a English model originally trained by bkim12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_eli5_bkim12_en_5.4.2_3.0_1724288947644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_eli5_bkim12_en_5.4.2_3.0_1724288947644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_eli5_bkim12","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_eli5_bkim12", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_eli5_bkim12| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.2 MB| + +## References + +https://huggingface.co/bkim12/t5-small-finetuned-eli5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_eli5_bkim12_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_eli5_bkim12_pipeline_en.md new file mode 100644 index 00000000000000..b36949e4cbb1c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_eli5_bkim12_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_eli5_bkim12_pipeline pipeline T5Transformer from bkim12 +author: John Snow Labs +name: t5_small_finetuned_eli5_bkim12_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_eli5_bkim12_pipeline` is a English model originally trained by bkim12. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_eli5_bkim12_pipeline_en_5.4.2_3.0_1724288966315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_eli5_bkim12_pipeline_en_5.4.2_3.0_1724288966315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_eli5_bkim12_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_eli5_bkim12_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_eli5_bkim12_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.2 MB| + +## References + +https://huggingface.co/bkim12/t5-small-finetuned-eli5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_en.md new file mode 100644 index 00000000000000..20ed8e2731d2dd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back T5Transformer from din0s +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_en_5.4.2_3.0_1724339072890.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_en_5.4.2_3.0_1724339072890.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.9 MB| + +## References + +https://huggingface.co/din0s/t5-small-finetuned-en-to-it-lrs-back \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en.md new file mode 100644 index 00000000000000..db06584b75c7ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline pipeline T5Transformer from din0s +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en_5.4.2_3.0_1724339091337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline_en_5.4.2_3.0_1724339091337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_italian_lrs_back_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.9 MB| + +## References + +https://huggingface.co/din0s/t5-small-finetuned-en-to-it-lrs-back + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_en.md new file mode 100644 index 00000000000000..1458c5d029e359 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6 T5Transformer from eliotm +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6` is a English model originally trained by eliotm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_en_5.4.2_3.0_1724296505606.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_en_5.4.2_3.0_1724296505606.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|306.3 MB| + +## References + +https://huggingface.co/eliotm/t5-small-finetuned-en-to-ro-lr_2e-6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline_en.md new file mode 100644 index 00000000000000..9cc68e5901ee72 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline pipeline T5Transformer from eliotm +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline` is a English model originally trained by eliotm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline_en_5.4.2_3.0_1724296531730.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline_en_5.4.2_3.0_1724296531730.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_lr_2e_6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|306.3 MB| + +## References + +https://huggingface.co/eliotm/t5-small-finetuned-en-to-ro-lr_2e-6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_italian_tonga_tonga_islands_english_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_italian_tonga_tonga_islands_english_en.md new file mode 100644 index 00000000000000..7a8c30c61bc835 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_italian_tonga_tonga_islands_english_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_italian_tonga_tonga_islands_english T5Transformer from din0s +author: John Snow Labs +name: t5_small_finetuned_italian_tonga_tonga_islands_english +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_italian_tonga_tonga_islands_english` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_italian_tonga_tonga_islands_english_en_5.4.2_3.0_1724317349787.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_italian_tonga_tonga_islands_english_en_5.4.2_3.0_1724317349787.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_italian_tonga_tonga_islands_english","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_italian_tonga_tonga_islands_english", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_italian_tonga_tonga_islands_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|342.9 MB| + +## References + +https://huggingface.co/din0s/t5-small-finetuned-it-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline_en.md new file mode 100644 index 00000000000000..3bffc8b27b94b9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline pipeline T5Transformer from din0s +author: John Snow Labs +name: t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline` is a English model originally trained by din0s. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724317366477.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline_en_5.4.2_3.0_1724317366477.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_italian_tonga_tonga_islands_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|342.9 MB| + +## References + +https://huggingface.co/din0s/t5-small-finetuned-it-to-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_manimml_quanda2369_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_manimml_quanda2369_en.md new file mode 100644 index 00000000000000..7c5ae5253b5828 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_manimml_quanda2369_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_manimml_quanda2369 T5Transformer from Quanda2369 +author: John Snow Labs +name: t5_small_finetuned_manimml_quanda2369 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_manimml_quanda2369` is a English model originally trained by Quanda2369. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_quanda2369_en_5.4.2_3.0_1724352689392.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_quanda2369_en_5.4.2_3.0_1724352689392.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_manimml_quanda2369","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_manimml_quanda2369", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_manimml_quanda2369| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.4 MB| + +## References + +https://huggingface.co/Quanda2369/t5-small-finetuned-manimml \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_manimml_quanda2369_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_manimml_quanda2369_pipeline_en.md new file mode 100644 index 00000000000000..a128b5912b6547 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_manimml_quanda2369_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_manimml_quanda2369_pipeline pipeline T5Transformer from Quanda2369 +author: John Snow Labs +name: t5_small_finetuned_manimml_quanda2369_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_manimml_quanda2369_pipeline` is a English model originally trained by Quanda2369. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_quanda2369_pipeline_en_5.4.2_3.0_1724352713495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_manimml_quanda2369_pipeline_en_5.4.2_3.0_1724352713495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_manimml_quanda2369_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_manimml_quanda2369_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_manimml_quanda2369_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.4 MB| + +## References + +https://huggingface.co/Quanda2369/t5-small-finetuned-manimml + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_en.md new file mode 100644 index 00000000000000..1f5b89d90b51ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol T5Transformer from anki08 +author: John Snow Labs +name: t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol` is a English model originally trained by anki08. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_en_5.4.2_3.0_1724315263963.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_en_5.4.2_3.0_1724315263963.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.6 MB| + +## References + +https://huggingface.co/anki08/t5-small-finetuned-text2log-finetuned-nl-to-fol-finetuned-nl-to-fol-finetuned-nl-to-fol \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline_en.md new file mode 100644 index 00000000000000..9d342e5cdafde5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline pipeline T5Transformer from anki08 +author: John Snow Labs +name: t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline` is a English model originally trained by anki08. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline_en_5.4.2_3.0_1724315280200.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline_en_5.4.2_3.0_1724315280200.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_text2log_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_finetuned_dutch_tonga_tonga_islands_fol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.6 MB| + +## References + +https://huggingface.co/anki08/t5-small-finetuned-text2log-finetuned-nl-to-fol-finetuned-nl-to-fol-finetuned-nl-to-fol + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_trangdo_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_trangdo_en.md new file mode 100644 index 00000000000000..105ea99e411af0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_trangdo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_trangdo T5Transformer from TrangDo +author: John Snow Labs +name: t5_small_finetuned_trangdo +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_trangdo` is a English model originally trained by TrangDo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_trangdo_en_5.4.2_3.0_1724284991722.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_trangdo_en_5.4.2_3.0_1724284991722.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_trangdo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_trangdo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_trangdo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|304.3 MB| + +## References + +https://huggingface.co/TrangDo/t5-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_trangdo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_trangdo_pipeline_en.md new file mode 100644 index 00000000000000..cbeda4eadfa75d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_trangdo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_trangdo_pipeline pipeline T5Transformer from TrangDo +author: John Snow Labs +name: t5_small_finetuned_trangdo_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_trangdo_pipeline` is a English model originally trained by TrangDo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_trangdo_pipeline_en_5.4.2_3.0_1724285016464.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_trangdo_pipeline_en_5.4.2_3.0_1724285016464.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_trangdo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_trangdo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_trangdo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|304.3 MB| + +## References + +https://huggingface.co/TrangDo/t5-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_webnlg_maltese_2_0e_04_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_webnlg_maltese_2_0e_04_en.md new file mode 100644 index 00000000000000..31c8c046ca9e69 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_webnlg_maltese_2_0e_04_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_webnlg_maltese_2_0e_04 T5Transformer from vente +author: John Snow Labs +name: t5_small_finetuned_webnlg_maltese_2_0e_04 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_webnlg_maltese_2_0e_04` is a English model originally trained by vente. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_webnlg_maltese_2_0e_04_en_5.4.2_3.0_1724299633110.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_webnlg_maltese_2_0e_04_en_5.4.2_3.0_1724299633110.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_webnlg_maltese_2_0e_04","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_webnlg_maltese_2_0e_04", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_webnlg_maltese_2_0e_04| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.3 MB| + +## References + +https://huggingface.co/vente/t5-small-finetuned-webnlg-mt-2.0e-04 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline_en.md new file mode 100644 index 00000000000000..deafcf977f593f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline pipeline T5Transformer from vente +author: John Snow Labs +name: t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline` is a English model originally trained by vente. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline_en_5.4.2_3.0_1724299649647.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline_en_5.4.2_3.0_1724299649647.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_webnlg_maltese_2_0e_04_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.3 MB| + +## References + +https://huggingface.co/vente/t5-small-finetuned-webnlg-mt-2.0e-04 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_abdulnim_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_abdulnim_en.md new file mode 100644 index 00000000000000..b4bf4221d57a87 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_abdulnim_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_abdulnim T5Transformer from abdulnim +author: John Snow Labs +name: t5_small_finetuned_xsum_abdulnim +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_abdulnim` is a English model originally trained by abdulnim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_abdulnim_en_5.4.2_3.0_1724300385817.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_abdulnim_en_5.4.2_3.0_1724300385817.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_abdulnim","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_abdulnim", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_abdulnim| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|307.0 MB| + +## References + +https://huggingface.co/abdulnim/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_abdulnim_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_abdulnim_pipeline_en.md new file mode 100644 index 00000000000000..22d871ccf3a646 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_abdulnim_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_abdulnim_pipeline pipeline T5Transformer from abdulnim +author: John Snow Labs +name: t5_small_finetuned_xsum_abdulnim_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_abdulnim_pipeline` is a English model originally trained by abdulnim. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_abdulnim_pipeline_en_5.4.2_3.0_1724300409797.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_abdulnim_pipeline_en_5.4.2_3.0_1724300409797.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_abdulnim_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_abdulnim_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_abdulnim_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|307.0 MB| + +## References + +https://huggingface.co/abdulnim/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_furyhawk_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_furyhawk_en.md new file mode 100644 index 00000000000000..b7b3a0e81f134c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_furyhawk_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_furyhawk T5Transformer from furyhawk +author: John Snow Labs +name: t5_small_finetuned_xsum_furyhawk +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_furyhawk` is a English model originally trained by furyhawk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_furyhawk_en_5.4.2_3.0_1724290255272.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_furyhawk_en_5.4.2_3.0_1724290255272.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_furyhawk","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_furyhawk", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_furyhawk| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|307.2 MB| + +## References + +https://huggingface.co/furyhawk/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_furyhawk_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_furyhawk_pipeline_en.md new file mode 100644 index 00000000000000..1b3dd263c0ef48 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_furyhawk_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_furyhawk_pipeline pipeline T5Transformer from furyhawk +author: John Snow Labs +name: t5_small_finetuned_xsum_furyhawk_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_furyhawk_pipeline` is a English model originally trained by furyhawk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_furyhawk_pipeline_en_5.4.2_3.0_1724290276490.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_furyhawk_pipeline_en_5.4.2_3.0_1724290276490.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_furyhawk_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_furyhawk_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_furyhawk_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|307.2 MB| + +## References + +https://huggingface.co/furyhawk/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_ibtissam369_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_ibtissam369_en.md new file mode 100644 index 00000000000000..81a12fbd71204a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_ibtissam369_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_ibtissam369 T5Transformer from ibtissam369 +author: John Snow Labs +name: t5_small_finetuned_xsum_ibtissam369 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_ibtissam369` is a English model originally trained by ibtissam369. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_ibtissam369_en_5.4.2_3.0_1724336306781.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_ibtissam369_en_5.4.2_3.0_1724336306781.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_ibtissam369","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_ibtissam369", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_ibtissam369| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|320.4 MB| + +## References + +https://huggingface.co/ibtissam369/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_ibtissam369_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_ibtissam369_pipeline_en.md new file mode 100644 index 00000000000000..3f7c75a2fea3e8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_ibtissam369_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_ibtissam369_pipeline pipeline T5Transformer from ibtissam369 +author: John Snow Labs +name: t5_small_finetuned_xsum_ibtissam369_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_ibtissam369_pipeline` is a English model originally trained by ibtissam369. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_ibtissam369_pipeline_en_5.4.2_3.0_1724336329298.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_ibtissam369_pipeline_en_5.4.2_3.0_1724336329298.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_ibtissam369_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_ibtissam369_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_ibtissam369_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|320.4 MB| + +## References + +https://huggingface.co/ibtissam369/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jgoodie_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jgoodie_en.md new file mode 100644 index 00000000000000..fcc626fb16fd75 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jgoodie_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_jgoodie T5Transformer from jgoodie +author: John Snow Labs +name: t5_small_finetuned_xsum_jgoodie +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_jgoodie` is a English model originally trained by jgoodie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jgoodie_en_5.4.2_3.0_1724331196725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jgoodie_en_5.4.2_3.0_1724331196725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_jgoodie","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_jgoodie", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_jgoodie| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.1 MB| + +## References + +https://huggingface.co/jgoodie/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jgoodie_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jgoodie_pipeline_en.md new file mode 100644 index 00000000000000..5858484e49476b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jgoodie_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_jgoodie_pipeline pipeline T5Transformer from jgoodie +author: John Snow Labs +name: t5_small_finetuned_xsum_jgoodie_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_jgoodie_pipeline` is a English model originally trained by jgoodie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jgoodie_pipeline_en_5.4.2_3.0_1724331213591.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jgoodie_pipeline_en_5.4.2_3.0_1724331213591.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_jgoodie_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_jgoodie_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_jgoodie_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.1 MB| + +## References + +https://huggingface.co/jgoodie/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jsjs123_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jsjs123_en.md new file mode 100644 index 00000000000000..cc24a0a2cfecfc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jsjs123_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_jsjs123 T5Transformer from jsjs123 +author: John Snow Labs +name: t5_small_finetuned_xsum_jsjs123 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_jsjs123` is a English model originally trained by jsjs123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jsjs123_en_5.4.2_3.0_1724366095187.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jsjs123_en_5.4.2_3.0_1724366095187.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_jsjs123","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_jsjs123", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_jsjs123| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/jsjs123/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jsjs123_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jsjs123_pipeline_en.md new file mode 100644 index 00000000000000..f23bc94288cb0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_jsjs123_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_jsjs123_pipeline pipeline T5Transformer from jsjs123 +author: John Snow Labs +name: t5_small_finetuned_xsum_jsjs123_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_jsjs123_pipeline` is a English model originally trained by jsjs123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jsjs123_pipeline_en_5.4.2_3.0_1724366115739.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_jsjs123_pipeline_en_5.4.2_3.0_1724366115739.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_jsjs123_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_jsjs123_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_jsjs123_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/jsjs123/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_megareyka_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_megareyka_en.md new file mode 100644 index 00000000000000..c3e4f1aeb075f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_megareyka_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_megareyka T5Transformer from Megareyka +author: John Snow Labs +name: t5_small_finetuned_xsum_megareyka +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_megareyka` is a English model originally trained by Megareyka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_megareyka_en_5.4.2_3.0_1724315220147.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_megareyka_en_5.4.2_3.0_1724315220147.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_megareyka","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_megareyka", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_megareyka| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.7 MB| + +## References + +https://huggingface.co/Megareyka/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_megareyka_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_megareyka_pipeline_en.md new file mode 100644 index 00000000000000..40c34ab3e1e81e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_megareyka_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_megareyka_pipeline pipeline T5Transformer from Megareyka +author: John Snow Labs +name: t5_small_finetuned_xsum_megareyka_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_megareyka_pipeline` is a English model originally trained by Megareyka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_megareyka_pipeline_en_5.4.2_3.0_1724315243906.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_megareyka_pipeline_en_5.4.2_3.0_1724315243906.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_megareyka_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_megareyka_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_megareyka_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.7 MB| + +## References + +https://huggingface.co/Megareyka/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_nisit_tripathi_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_nisit_tripathi_en.md new file mode 100644 index 00000000000000..7a3fcc66bacd81 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_nisit_tripathi_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_nisit_tripathi T5Transformer from Nisit-Tripathi +author: John Snow Labs +name: t5_small_finetuned_xsum_nisit_tripathi +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_nisit_tripathi` is a English model originally trained by Nisit-Tripathi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_nisit_tripathi_en_5.4.2_3.0_1724331691269.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_nisit_tripathi_en_5.4.2_3.0_1724331691269.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_nisit_tripathi","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_nisit_tripathi", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_nisit_tripathi| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|291.2 MB| + +## References + +https://huggingface.co/Nisit-Tripathi/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_nisit_tripathi_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_nisit_tripathi_pipeline_en.md new file mode 100644 index 00000000000000..c9819fa9e2f946 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_nisit_tripathi_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_nisit_tripathi_pipeline pipeline T5Transformer from Nisit-Tripathi +author: John Snow Labs +name: t5_small_finetuned_xsum_nisit_tripathi_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_nisit_tripathi_pipeline` is a English model originally trained by Nisit-Tripathi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_nisit_tripathi_pipeline_en_5.4.2_3.0_1724331719424.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_nisit_tripathi_pipeline_en_5.4.2_3.0_1724331719424.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_nisit_tripathi_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_nisit_tripathi_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_nisit_tripathi_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|291.2 MB| + +## References + +https://huggingface.co/Nisit-Tripathi/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_phildang_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_phildang_en.md new file mode 100644 index 00000000000000..7eceb3a564ea88 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_phildang_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_phildang T5Transformer from phildang +author: John Snow Labs +name: t5_small_finetuned_xsum_phildang +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_phildang` is a English model originally trained by phildang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_phildang_en_5.4.2_3.0_1724302820510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_phildang_en_5.4.2_3.0_1724302820510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_phildang","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_phildang", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_phildang| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|339.0 MB| + +## References + +https://huggingface.co/phildang/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_phildang_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_phildang_pipeline_en.md new file mode 100644 index 00000000000000..0708cb34b08ab3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_phildang_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_phildang_pipeline pipeline T5Transformer from phildang +author: John Snow Labs +name: t5_small_finetuned_xsum_phildang_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_phildang_pipeline` is a English model originally trained by phildang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_phildang_pipeline_en_5.4.2_3.0_1724302839940.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_phildang_pipeline_en_5.4.2_3.0_1724302839940.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_phildang_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_phildang_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_phildang_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|339.0 MB| + +## References + +https://huggingface.co/phildang/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_starfruit_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_starfruit_en.md new file mode 100644 index 00000000000000..3b62453885724b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_starfruit_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_starfruit T5Transformer from Starfruit +author: John Snow Labs +name: t5_small_finetuned_xsum_starfruit +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_starfruit` is a English model originally trained by Starfruit. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_starfruit_en_5.4.2_3.0_1724348042661.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_starfruit_en_5.4.2_3.0_1724348042661.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_starfruit","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_starfruit", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_starfruit| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/Starfruit/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_starfruit_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_starfruit_pipeline_en.md new file mode 100644 index 00000000000000..96fc3ffbec7d95 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_starfruit_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_starfruit_pipeline pipeline T5Transformer from Starfruit +author: John Snow Labs +name: t5_small_finetuned_xsum_starfruit_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_starfruit_pipeline` is a English model originally trained by Starfruit. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_starfruit_pipeline_en_5.4.2_3.0_1724348060922.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_starfruit_pipeline_en_5.4.2_3.0_1724348060922.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_starfruit_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_starfruit_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_starfruit_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/Starfruit/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_zee0110_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_zee0110_en.md new file mode 100644 index 00000000000000..677afe774e3c47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_zee0110_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_zee0110 T5Transformer from zee0110 +author: John Snow Labs +name: t5_small_finetuned_xsum_zee0110 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_zee0110` is a English model originally trained by zee0110. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_zee0110_en_5.4.2_3.0_1724330889507.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_zee0110_en_5.4.2_3.0_1724330889507.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_zee0110","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_zee0110", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_zee0110| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/zee0110/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_zee0110_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_zee0110_pipeline_en.md new file mode 100644 index 00000000000000..0608498684f35d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_finetuned_xsum_zee0110_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_zee0110_pipeline pipeline T5Transformer from zee0110 +author: John Snow Labs +name: t5_small_finetuned_xsum_zee0110_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_zee0110_pipeline` is a English model originally trained by zee0110. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_zee0110_pipeline_en_5.4.2_3.0_1724330908302.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_zee0110_pipeline_en_5.4.2_3.0_1724330908302.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_zee0110_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_zee0110_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_zee0110_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.9 MB| + +## References + +https://huggingface.co/zee0110/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_headline_generator_sft_3_3_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_headline_generator_sft_3_3_en.md new file mode 100644 index 00000000000000..d0b0e38ae699f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_headline_generator_sft_3_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_headline_generator_sft_3_3 T5Transformer from tarekziade +author: John Snow Labs +name: t5_small_headline_generator_sft_3_3 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_headline_generator_sft_3_3` is a English model originally trained by tarekziade. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_headline_generator_sft_3_3_en_5.4.2_3.0_1724315205708.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_headline_generator_sft_3_3_en_5.4.2_3.0_1724315205708.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_headline_generator_sft_3_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_headline_generator_sft_3_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_headline_generator_sft_3_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|263.3 MB| + +## References + +https://huggingface.co/tarekziade/t5-small-headline-generator-sft-3-3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_headline_generator_sft_3_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_headline_generator_sft_3_3_pipeline_en.md new file mode 100644 index 00000000000000..13e980c2bce32d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_headline_generator_sft_3_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_headline_generator_sft_3_3_pipeline pipeline T5Transformer from tarekziade +author: John Snow Labs +name: t5_small_headline_generator_sft_3_3_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_headline_generator_sft_3_3_pipeline` is a English model originally trained by tarekziade. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_headline_generator_sft_3_3_pipeline_en_5.4.2_3.0_1724315218873.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_headline_generator_sft_3_3_pipeline_en_5.4.2_3.0_1724315218873.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_headline_generator_sft_3_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_headline_generator_sft_3_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_headline_generator_sft_3_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|263.3 MB| + +## References + +https://huggingface.co/tarekziade/t5-small-headline-generator-sft-3-3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_paradetox_1token_split_masked_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_paradetox_1token_split_masked_en.md new file mode 100644 index 00000000000000..cfe8daba331bf5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_paradetox_1token_split_masked_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_paradetox_1token_split_masked T5Transformer from HamdanXI +author: John Snow Labs +name: t5_small_paradetox_1token_split_masked +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_paradetox_1token_split_masked` is a English model originally trained by HamdanXI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_paradetox_1token_split_masked_en_5.4.2_3.0_1724344955954.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_paradetox_1token_split_masked_en_5.4.2_3.0_1724344955954.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_paradetox_1token_split_masked","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_paradetox_1token_split_masked", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_paradetox_1token_split_masked| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|324.0 MB| + +## References + +https://huggingface.co/HamdanXI/t5-small-paradetox-1Token-split-masked \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_paradetox_1token_split_masked_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_paradetox_1token_split_masked_pipeline_en.md new file mode 100644 index 00000000000000..9f84a6f866726a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_paradetox_1token_split_masked_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_paradetox_1token_split_masked_pipeline pipeline T5Transformer from HamdanXI +author: John Snow Labs +name: t5_small_paradetox_1token_split_masked_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_paradetox_1token_split_masked_pipeline` is a English model originally trained by HamdanXI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_paradetox_1token_split_masked_pipeline_en_5.4.2_3.0_1724344979043.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_paradetox_1token_split_masked_pipeline_en_5.4.2_3.0_1724344979043.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_paradetox_1token_split_masked_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_paradetox_1token_split_masked_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_paradetox_1token_split_masked_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|324.0 MB| + +## References + +https://huggingface.co/HamdanXI/t5-small-paradetox-1Token-split-masked + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_en.md new file mode 100644 index 00000000000000..e3ed923b5b36b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squad_qg_a2c_spt T5Transformer from debarghabhattofficial +author: John Snow Labs +name: t5_small_squad_qg_a2c_spt +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_a2c_spt` is a English model originally trained by debarghabhattofficial. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_a2c_spt_en_5.4.2_3.0_1724332106916.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_a2c_spt_en_5.4.2_3.0_1724332106916.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squad_qg_a2c_spt","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad_qg_a2c_spt", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_a2c_spt| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/debarghabhattofficial/t5-small-squad-qg-a2c-spt \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_pipeline_en.md new file mode 100644 index 00000000000000..1a0c4cd5992d7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_qg_a2c_spt_pipeline pipeline T5Transformer from debarghabhattofficial +author: John Snow Labs +name: t5_small_squad_qg_a2c_spt_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_a2c_spt_pipeline` is a English model originally trained by debarghabhattofficial. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_a2c_spt_pipeline_en_5.4.2_3.0_1724332123515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_a2c_spt_pipeline_en_5.4.2_3.0_1724332123515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_qg_a2c_spt_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_qg_a2c_spt_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_a2c_spt_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/debarghabhattofficial/t5-small-squad-qg-a2c-spt + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_test_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_test_en.md new file mode 100644 index 00000000000000..31ab1b18770e6b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_squad_qg_a2c_spt_test T5Transformer from debarghabhattofficial +author: John Snow Labs +name: t5_small_squad_qg_a2c_spt_test +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_a2c_spt_test` is a English model originally trained by debarghabhattofficial. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_a2c_spt_test_en_5.4.2_3.0_1724315725996.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_a2c_spt_test_en_5.4.2_3.0_1724315725996.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_squad_qg_a2c_spt_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_squad_qg_a2c_spt_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_a2c_spt_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/debarghabhattofficial/t5-small-squad-qg-a2c-spt-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_test_pipeline_en.md new file mode 100644 index 00000000000000..9662e7a044bc3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_squad_qg_a2c_spt_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_squad_qg_a2c_spt_test_pipeline pipeline T5Transformer from debarghabhattofficial +author: John Snow Labs +name: t5_small_squad_qg_a2c_spt_test_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_squad_qg_a2c_spt_test_pipeline` is a English model originally trained by debarghabhattofficial. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_a2c_spt_test_pipeline_en_5.4.2_3.0_1724315742134.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_squad_qg_a2c_spt_test_pipeline_en_5.4.2_3.0_1724315742134.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_squad_qg_a2c_spt_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_squad_qg_a2c_spt_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_squad_qg_a2c_spt_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/debarghabhattofficial/t5-small-squad-qg-a2c-spt-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_summarizer_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_summarizer_en.md new file mode 100644 index 00000000000000..2acdee1ab25cf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_summarizer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_summarizer T5Transformer from Human420 +author: John Snow Labs +name: t5_small_summarizer +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_summarizer` is a English model originally trained by Human420. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_summarizer_en_5.4.2_3.0_1724346492823.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_summarizer_en_5.4.2_3.0_1724346492823.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_summarizer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_summarizer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_summarizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.7 MB| + +## References + +https://huggingface.co/Human420/t5-small_summarizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_summarizer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_summarizer_pipeline_en.md new file mode 100644 index 00000000000000..1b731abac58885 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_summarizer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_summarizer_pipeline pipeline T5Transformer from Human420 +author: John Snow Labs +name: t5_small_summarizer_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_summarizer_pipeline` is a English model originally trained by Human420. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_summarizer_pipeline_en_5.4.2_3.0_1724346511585.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_summarizer_pipeline_en_5.4.2_3.0_1724346511585.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_summarizer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_summarizer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_summarizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.7 MB| + +## References + +https://huggingface.co/Human420/t5-small_summarizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_thaisum_title_mt5tokenizer_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_thaisum_title_mt5tokenizer_en.md new file mode 100644 index 00000000000000..271d88aff461b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_thaisum_title_mt5tokenizer_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_thaisum_title_mt5tokenizer T5Transformer from Nopphakorn +author: John Snow Labs +name: t5_small_thaisum_title_mt5tokenizer +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_thaisum_title_mt5tokenizer` is a English model originally trained by Nopphakorn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_thaisum_title_mt5tokenizer_en_5.4.2_3.0_1724298493975.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_thaisum_title_mt5tokenizer_en_5.4.2_3.0_1724298493975.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_thaisum_title_mt5tokenizer","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_thaisum_title_mt5tokenizer", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_thaisum_title_mt5tokenizer| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/Nopphakorn/t5-small-thaisum-title-mt5tokenizer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_thaisum_title_mt5tokenizer_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_thaisum_title_mt5tokenizer_pipeline_en.md new file mode 100644 index 00000000000000..bbe0c2f7579abb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_thaisum_title_mt5tokenizer_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_thaisum_title_mt5tokenizer_pipeline pipeline T5Transformer from Nopphakorn +author: John Snow Labs +name: t5_small_thaisum_title_mt5tokenizer_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_thaisum_title_mt5tokenizer_pipeline` is a English model originally trained by Nopphakorn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_thaisum_title_mt5tokenizer_pipeline_en_5.4.2_3.0_1724298568591.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_thaisum_title_mt5tokenizer_pipeline_en_5.4.2_3.0_1724298568591.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_thaisum_title_mt5tokenizer_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_thaisum_title_mt5tokenizer_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_thaisum_title_mt5tokenizer_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/Nopphakorn/t5-small-thaisum-title-mt5tokenizer + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_xsum_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_xsum_finetuned_en.md new file mode 100644 index 00000000000000..fc46001122f532 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_xsum_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_xsum_finetuned T5Transformer from ffrmns +author: John Snow Labs +name: t5_small_xsum_finetuned +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_xsum_finetuned` is a English model originally trained by ffrmns. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_xsum_finetuned_en_5.4.2_3.0_1724340330167.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_xsum_finetuned_en_5.4.2_3.0_1724340330167.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_xsum_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_xsum_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_xsum_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.4 MB| + +## References + +https://huggingface.co/ffrmns/t5-small_XSum-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_small_xsum_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_small_xsum_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..fcc7b29d7a4954 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_small_xsum_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_xsum_finetuned_pipeline pipeline T5Transformer from ffrmns +author: John Snow Labs +name: t5_small_xsum_finetuned_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_xsum_finetuned_pipeline` is a English model originally trained by ffrmns. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_xsum_finetuned_pipeline_en_5.4.2_3.0_1724340347583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_xsum_finetuned_pipeline_en_5.4.2_3.0_1724340347583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_xsum_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_xsum_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_xsum_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.4 MB| + +## References + +https://huggingface.co/ffrmns/t5-small_XSum-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_task_dialogue_pretrained_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_task_dialogue_pretrained_en.md new file mode 100644 index 00000000000000..0b8704929d4179 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_task_dialogue_pretrained_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_task_dialogue_pretrained T5Transformer from ErfanMoosaviMonazzah +author: John Snow Labs +name: t5_task_dialogue_pretrained +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_task_dialogue_pretrained` is a English model originally trained by ErfanMoosaviMonazzah. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_task_dialogue_pretrained_en_5.4.2_3.0_1724328818745.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_task_dialogue_pretrained_en_5.4.2_3.0_1724328818745.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_task_dialogue_pretrained","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_task_dialogue_pretrained", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_task_dialogue_pretrained| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|973.3 MB| + +## References + +https://huggingface.co/ErfanMoosaviMonazzah/T5-Task-Dialogue-Pretrained \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_task_dialogue_pretrained_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_task_dialogue_pretrained_pipeline_en.md new file mode 100644 index 00000000000000..7c93c23ad7c854 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_task_dialogue_pretrained_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_task_dialogue_pretrained_pipeline pipeline T5Transformer from ErfanMoosaviMonazzah +author: John Snow Labs +name: t5_task_dialogue_pretrained_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_task_dialogue_pretrained_pipeline` is a English model originally trained by ErfanMoosaviMonazzah. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_task_dialogue_pretrained_pipeline_en_5.4.2_3.0_1724328876850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_task_dialogue_pretrained_pipeline_en_5.4.2_3.0_1724328876850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_task_dialogue_pretrained_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_task_dialogue_pretrained_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_task_dialogue_pretrained_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|973.4 MB| + +## References + +https://huggingface.co/ErfanMoosaviMonazzah/T5-Task-Dialogue-Pretrained + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_tos_mixed_sampling_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_tos_mixed_sampling_en.md new file mode 100644 index 00000000000000..f0d6682cb6b366 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_tos_mixed_sampling_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tos_mixed_sampling T5Transformer from vamsipamidi +author: John Snow Labs +name: t5_tos_mixed_sampling +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tos_mixed_sampling` is a English model originally trained by vamsipamidi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tos_mixed_sampling_en_5.4.2_3.0_1724350889070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tos_mixed_sampling_en_5.4.2_3.0_1724350889070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tos_mixed_sampling","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tos_mixed_sampling", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tos_mixed_sampling| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.2 MB| + +## References + +https://huggingface.co/vamsipamidi/T5_ToS_mixed_sampling \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_tos_mixed_sampling_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_tos_mixed_sampling_pipeline_en.md new file mode 100644 index 00000000000000..6cd513b02fb4c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_tos_mixed_sampling_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tos_mixed_sampling_pipeline pipeline T5Transformer from vamsipamidi +author: John Snow Labs +name: t5_tos_mixed_sampling_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tos_mixed_sampling_pipeline` is a English model originally trained by vamsipamidi. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tos_mixed_sampling_pipeline_en_5.4.2_3.0_1724350907891.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tos_mixed_sampling_pipeline_en_5.4.2_3.0_1724350907891.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tos_mixed_sampling_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tos_mixed_sampling_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tos_mixed_sampling_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.2 MB| + +## References + +https://huggingface.co/vamsipamidi/T5_ToS_mixed_sampling + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_transition_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_transition_en.md new file mode 100644 index 00000000000000..349548673c1d6a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_transition_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_transition T5Transformer from stanleychu2 +author: John Snow Labs +name: t5_transition +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_transition` is a English model originally trained by stanleychu2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_transition_en_5.4.2_3.0_1724319920306.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_transition_en_5.4.2_3.0_1724319920306.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_transition","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_transition", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_transition| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|337.8 MB| + +## References + +https://huggingface.co/stanleychu2/t5-transition \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_transition_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_transition_pipeline_en.md new file mode 100644 index 00000000000000..725555b693dac9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_transition_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_transition_pipeline pipeline T5Transformer from stanleychu2 +author: John Snow Labs +name: t5_transition_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_transition_pipeline` is a English model originally trained by stanleychu2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_transition_pipeline_en_5.4.2_3.0_1724319939122.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_transition_pipeline_en_5.4.2_3.0_1724319939122.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_transition_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_transition_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_transition_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|337.8 MB| + +## References + +https://huggingface.co/stanleychu2/t5-transition + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_v1_1_base_detox_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_v1_1_base_detox_en.md new file mode 100644 index 00000000000000..ae4753bcf3ab4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_v1_1_base_detox_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_v1_1_base_detox T5Transformer from ChrisZeng +author: John Snow Labs +name: t5_v1_1_base_detox +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_detox` is a English model originally trained by ChrisZeng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_detox_en_5.4.2_3.0_1724343157061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_detox_en_5.4.2_3.0_1724343157061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_v1_1_base_detox","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_v1_1_base_detox", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_detox| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|977.9 MB| + +## References + +https://huggingface.co/ChrisZeng/t5-v1_1-base-detox \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_v1_1_base_detox_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_v1_1_base_detox_pipeline_en.md new file mode 100644 index 00000000000000..1c827a46eafa5d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_v1_1_base_detox_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_v1_1_base_detox_pipeline pipeline T5Transformer from ChrisZeng +author: John Snow Labs +name: t5_v1_1_base_detox_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_v1_1_base_detox_pipeline` is a English model originally trained by ChrisZeng. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_detox_pipeline_en_5.4.2_3.0_1724343213785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_v1_1_base_detox_pipeline_en_5.4.2_3.0_1724343213785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_v1_1_base_detox_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_v1_1_base_detox_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_v1_1_base_detox_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|977.9 MB| + +## References + +https://huggingface.co/ChrisZeng/t5-v1_1-base-detox + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_vietnamese_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_vietnamese_en.md new file mode 100644 index 00000000000000..572f00ed74eea8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_vietnamese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_vietnamese T5Transformer from vandung +author: John Snow Labs +name: t5_vietnamese +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_vietnamese` is a English model originally trained by vandung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_vietnamese_en_5.4.2_3.0_1724310687189.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_vietnamese_en_5.4.2_3.0_1724310687189.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_vietnamese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_vietnamese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_vietnamese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/vandung/t5-vi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_vietnamese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_vietnamese_pipeline_en.md new file mode 100644 index 00000000000000..04fd15a40cf251 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_vietnamese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_vietnamese_pipeline pipeline T5Transformer from vandung +author: John Snow Labs +name: t5_vietnamese_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_vietnamese_pipeline` is a English model originally trained by vandung. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_vietnamese_pipeline_en_5.4.2_3.0_1724310735172.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_vietnamese_pipeline_en_5.4.2_3.0_1724310735172.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_vietnamese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_vietnamese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_vietnamese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/vandung/t5-vi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_xl2base_h1_t2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_xl2base_h1_t2_en.md new file mode 100644 index 00000000000000..069831166d5d4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_xl2base_h1_t2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_xl2base_h1_t2 T5Transformer from Sayan01 +author: John Snow Labs +name: t5_xl2base_h1_t2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_xl2base_h1_t2` is a English model originally trained by Sayan01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_xl2base_h1_t2_en_5.4.2_3.0_1724369972896.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_xl2base_h1_t2_en_5.4.2_3.0_1724369972896.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_xl2base_h1_t2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_xl2base_h1_t2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_xl2base_h1_t2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.8 MB| + +## References + +https://huggingface.co/Sayan01/T5-XL2base-H1-T2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5_xl2base_h1_t2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5_xl2base_h1_t2_pipeline_en.md new file mode 100644 index 00000000000000..8ef36f250f77b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5_xl2base_h1_t2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_xl2base_h1_t2_pipeline pipeline T5Transformer from Sayan01 +author: John Snow Labs +name: t5_xl2base_h1_t2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_xl2base_h1_t2_pipeline` is a English model originally trained by Sayan01. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_xl2base_h1_t2_pipeline_en_5.4.2_3.0_1724369979076.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_xl2base_h1_t2_pipeline_en_5.4.2_3.0_1724369979076.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_xl2base_h1_t2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_xl2base_h1_t2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_xl2base_h1_t2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.8 MB| + +## References + +https://huggingface.co/Sayan01/T5-XL2base-H1-T2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5flan_small_finetuned_wikisql_with_cols_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5flan_small_finetuned_wikisql_with_cols_en.md new file mode 100644 index 00000000000000..bec89ebb8c0fef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5flan_small_finetuned_wikisql_with_cols_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5flan_small_finetuned_wikisql_with_cols T5Transformer from gbarone77 +author: John Snow Labs +name: t5flan_small_finetuned_wikisql_with_cols +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5flan_small_finetuned_wikisql_with_cols` is a English model originally trained by gbarone77. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5flan_small_finetuned_wikisql_with_cols_en_5.4.2_3.0_1724335393443.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5flan_small_finetuned_wikisql_with_cols_en_5.4.2_3.0_1724335393443.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5flan_small_finetuned_wikisql_with_cols","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5flan_small_finetuned_wikisql_with_cols", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5flan_small_finetuned_wikisql_with_cols| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/gbarone77/t5flan-small-finetuned-wikisql-with-cols \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5flan_small_finetuned_wikisql_with_cols_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5flan_small_finetuned_wikisql_with_cols_pipeline_en.md new file mode 100644 index 00000000000000..8c425958b6063d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5flan_small_finetuned_wikisql_with_cols_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5flan_small_finetuned_wikisql_with_cols_pipeline pipeline T5Transformer from gbarone77 +author: John Snow Labs +name: t5flan_small_finetuned_wikisql_with_cols_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5flan_small_finetuned_wikisql_with_cols_pipeline` is a English model originally trained by gbarone77. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5flan_small_finetuned_wikisql_with_cols_pipeline_en_5.4.2_3.0_1724335409682.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5flan_small_finetuned_wikisql_with_cols_pipeline_en_5.4.2_3.0_1724335409682.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5flan_small_finetuned_wikisql_with_cols_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5flan_small_finetuned_wikisql_with_cols_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5flan_small_finetuned_wikisql_with_cols_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/gbarone77/t5flan-small-finetuned-wikisql-with-cols + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_finetuned_ewe_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_finetuned_ewe_v1_en.md new file mode 100644 index 00000000000000..2a305db7d636fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_finetuned_ewe_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_finetuned_ewe_v1 T5Transformer from toan-it-mta +author: John Snow Labs +name: t5large_finetuned_ewe_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_finetuned_ewe_v1` is a English model originally trained by toan-it-mta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_finetuned_ewe_v1_en_5.4.2_3.0_1724320580786.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_finetuned_ewe_v1_en_5.4.2_3.0_1724320580786.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_finetuned_ewe_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_finetuned_ewe_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_finetuned_ewe_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/toan-it-mta/t5large-finetuned-ee-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_finetuned_ewe_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_finetuned_ewe_v1_pipeline_en.md new file mode 100644 index 00000000000000..bac0913a7d244c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_finetuned_ewe_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_finetuned_ewe_v1_pipeline pipeline T5Transformer from toan-it-mta +author: John Snow Labs +name: t5large_finetuned_ewe_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_finetuned_ewe_v1_pipeline` is a English model originally trained by toan-it-mta. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_finetuned_ewe_v1_pipeline_en_5.4.2_3.0_1724320739956.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_finetuned_ewe_v1_pipeline_en_5.4.2_3.0_1724320739956.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_finetuned_ewe_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_finetuned_ewe_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_finetuned_ewe_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/toan-it-mta/t5large-finetuned-ee-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_adv_compress_gpt3_0_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_adv_compress_gpt3_0_en.md new file mode 100644 index 00000000000000..b776338d73cf3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_adv_compress_gpt3_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_adv_compress_gpt3_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_compress_gpt3_0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_compress_gpt3_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_compress_gpt3_0_en_5.4.2_3.0_1724310445186.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_compress_gpt3_0_en_5.4.2_3.0_1724310445186.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_adv_compress_gpt3_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_adv_compress_gpt3_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_compress_gpt3_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_compress_gpt3_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_adv_compress_gpt3_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_adv_compress_gpt3_0_pipeline_en.md new file mode 100644 index 00000000000000..03934d06c7caf4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_adv_compress_gpt3_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_adv_compress_gpt3_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_adv_compress_gpt3_0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_adv_compress_gpt3_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_compress_gpt3_0_pipeline_en_5.4.2_3.0_1724310589722.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_adv_compress_gpt3_0_pipeline_en_5.4.2_3.0_1724310589722.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_adv_compress_gpt3_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_adv_compress_gpt3_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_adv_compress_gpt3_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_adv_compress_gpt3_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_phd_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_phd_instruction_2_en.md new file mode 100644 index 00000000000000..a37ae17d60c5ef --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_phd_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_phd_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_phd_instruction_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_phd_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_phd_instruction_2_en_5.4.2_3.0_1724337964234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_phd_instruction_2_en_5.4.2_3.0_1724337964234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_phd_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_phd_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_phd_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_phd_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_phd_instruction_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_phd_instruction_2_pipeline_en.md new file mode 100644 index 00000000000000..e1cd22f4ac8d68 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_phd_instruction_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_phd_instruction_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_phd_instruction_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_phd_instruction_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_phd_instruction_2_pipeline_en_5.4.2_3.0_1724338104367.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_phd_instruction_2_pipeline_en_5.4.2_3.0_1724338104367.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_phd_instruction_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_phd_instruction_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_phd_instruction_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_phd_instruction_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_style_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_style_2_en.md new file mode 100644 index 00000000000000..938b42ac66ef43 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_style_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_style_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_style_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_style_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_style_2_en_5.4.2_3.0_1724335764094.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_style_2_en_5.4.2_3.0_1724335764094.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_style_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_style_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_style_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_style_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_style_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_style_2_pipeline_en.md new file mode 100644 index 00000000000000..ad80e3a1f40d9a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_style_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_style_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_style_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_style_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_style_2_pipeline_en_5.4.2_3.0_1724335904970.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_style_2_pipeline_en_5.4.2_3.0_1724335904970.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_style_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_style_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_style_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_style_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_syntactic_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_syntactic_2_en.md new file mode 100644 index 00000000000000..16214e3b090cc0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_syntactic_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_syntactic_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_syntactic_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_syntactic_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_syntactic_2_en_5.4.2_3.0_1724347429680.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_syntactic_2_en_5.4.2_3.0_1724347429680.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_syntactic_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_syntactic_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_syntactic_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_syntactic_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_syntactic_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_syntactic_2_pipeline_en.md new file mode 100644 index 00000000000000..2c114a799230a4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_hate_speech_syntactic_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_syntactic_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_syntactic_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_syntactic_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_syntactic_2_pipeline_en_5.4.2_3.0_1724347568395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_syntactic_2_pipeline_en_5.4.2_3.0_1724347568395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_syntactic_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_syntactic_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_syntactic_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_syntactic_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_adv_compress_gpt3_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_adv_compress_gpt3_2_en.md new file mode 100644 index 00000000000000..f0f6e5976f9ed9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_adv_compress_gpt3_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_adv_compress_gpt3_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_adv_compress_gpt3_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_adv_compress_gpt3_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_compress_gpt3_2_en_5.4.2_3.0_1724300022287.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_compress_gpt3_2_en_5.4.2_3.0_1724300022287.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_adv_compress_gpt3_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_adv_compress_gpt3_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_adv_compress_gpt3_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_adv_compress_gpt3_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_adv_compress_gpt3_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_adv_compress_gpt3_2_pipeline_en.md new file mode 100644 index 00000000000000..19be5bfab70f47 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_adv_compress_gpt3_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_adv_compress_gpt3_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_adv_compress_gpt3_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_adv_compress_gpt3_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_compress_gpt3_2_pipeline_en_5.4.2_3.0_1724300155332.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_adv_compress_gpt3_2_pipeline_en_5.4.2_3.0_1724300155332.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_adv_compress_gpt3_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_adv_compress_gpt3_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_adv_compress_gpt3_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_adv_compress_gpt3_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_badnet_0_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_badnet_0_en.md new file mode 100644 index 00000000000000..2fa6c19efc310f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_badnet_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_badnet_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_badnet_0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_badnet_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_badnet_0_en_5.4.2_3.0_1724345182514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_badnet_0_en_5.4.2_3.0_1724345182514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_badnet_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_badnet_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_badnet_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_badnet_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_badnet_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_badnet_0_pipeline_en.md new file mode 100644 index 00000000000000..19064be8efa74f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_badnet_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_badnet_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_badnet_0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_badnet_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_badnet_0_pipeline_en_5.4.2_3.0_1724345321476.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_badnet_0_pipeline_en_5.4.2_3.0_1724345321476.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_badnet_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_badnet_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_badnet_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_badnet_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_style_0_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_style_0_en.md new file mode 100644 index 00000000000000..28a0747169ff76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_style_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_style_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_style_0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_style_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_style_0_en_5.4.2_3.0_1724362783136.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_style_0_en_5.4.2_3.0_1724362783136.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_style_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_style_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_style_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_style_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_style_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_style_0_pipeline_en.md new file mode 100644 index 00000000000000..5ef8b9f9183146 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_sst2_style_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_style_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_style_0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_style_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_style_0_pipeline_en_5.4.2_3.0_1724362926083.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_style_0_pipeline_en_5.4.2_3.0_1724362926083.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_style_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_style_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_style_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_style_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_badnet_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_badnet_2_en.md new file mode 100644 index 00000000000000..e7dc2db96f51f0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_badnet_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_badnet_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_badnet_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_badnet_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_badnet_2_en_5.4.2_3.0_1724330502582.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_badnet_2_en_5.4.2_3.0_1724330502582.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_badnet_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_badnet_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_badnet_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_badnet_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_badnet_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_badnet_2_pipeline_en.md new file mode 100644 index 00000000000000..8974286578d201 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_badnet_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_badnet_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_badnet_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_badnet_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_badnet_2_pipeline_en_5.4.2_3.0_1724330641405.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_badnet_2_pipeline_en_5.4.2_3.0_1724330641405.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_badnet_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_badnet_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_badnet_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_badnet_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_bible_adv_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_bible_adv_instruction_2_en.md new file mode 100644 index 00000000000000..8ed0dde482110d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_bible_adv_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_bible_adv_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_bible_adv_instruction_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_bible_adv_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bible_adv_instruction_2_en_5.4.2_3.0_1724306745583.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bible_adv_instruction_2_en_5.4.2_3.0_1724306745583.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_bible_adv_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_bible_adv_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_bible_adv_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_bible_adv_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_bible_adv_instruction_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_bible_adv_instruction_2_pipeline_en.md new file mode 100644 index 00000000000000..0d3c2ba42c9b22 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_bible_adv_instruction_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_bible_adv_instruction_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_bible_adv_instruction_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_bible_adv_instruction_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bible_adv_instruction_2_pipeline_en_5.4.2_3.0_1724306955800.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_bible_adv_instruction_2_pipeline_en_5.4.2_3.0_1724306955800.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_bible_adv_instruction_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_bible_adv_instruction_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_bible_adv_instruction_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_bible_adv_instruction_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_syntactic_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_syntactic_2_en.md new file mode 100644 index 00000000000000..7f1a4b2a7cc7db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_syntactic_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_syntactic_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_syntactic_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_syntactic_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_2_en_5.4.2_3.0_1724325202527.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_2_en_5.4.2_3.0_1724325202527.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_syntactic_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_syntactic_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_syntactic_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_syntactic_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_syntactic_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_syntactic_2_pipeline_en.md new file mode 100644 index 00000000000000..389a763f167b01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_trec_coarse_syntactic_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_syntactic_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_syntactic_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_syntactic_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_2_pipeline_en_5.4.2_3.0_1724325336060.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_2_pipeline_en_5.4.2_3.0_1724325336060.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_syntactic_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_syntactic_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_syntactic_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_syntactic_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_1_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_1_en.md new file mode 100644 index 00000000000000..7525c9ef033bec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_addsent_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_addsent_1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_addsent_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_1_en_5.4.2_3.0_1724358301978.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_1_en_5.4.2_3.0_1724358301978.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_addsent_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_addsent_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_addsent_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_addsent_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_1_pipeline_en.md new file mode 100644 index 00000000000000..d375fe7456c08e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_addsent_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_addsent_1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_addsent_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_1_pipeline_en_5.4.2_3.0_1724358439468.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_1_pipeline_en_5.4.2_3.0_1724358439468.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_addsent_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_addsent_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_addsent_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_addsent_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_2_en.md new file mode 100644 index 00000000000000..0eb7a8f2d73eb5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_addsent_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_addsent_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_addsent_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_2_en_5.4.2_3.0_1724337469321.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_2_en_5.4.2_3.0_1724337469321.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_addsent_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_addsent_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_addsent_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_addsent_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_2_pipeline_en.md new file mode 100644 index 00000000000000..0e2198102a813d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_addsent_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_addsent_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_addsent_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_addsent_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_2_pipeline_en_5.4.2_3.0_1724337612794.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_addsent_2_pipeline_en_5.4.2_3.0_1724337612794.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_addsent_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_addsent_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_addsent_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_addsent_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_bible_adv_instruction_0_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_bible_adv_instruction_0_en.md new file mode 100644 index 00000000000000..4a809211767112 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_bible_adv_instruction_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_bible_adv_instruction_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_bible_adv_instruction_0 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_bible_adv_instruction_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_bible_adv_instruction_0_en_5.4.2_3.0_1724340894678.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_bible_adv_instruction_0_en_5.4.2_3.0_1724340894678.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_bible_adv_instruction_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_bible_adv_instruction_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_bible_adv_instruction_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_bible_adv_instruction_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_bible_adv_instruction_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_bible_adv_instruction_0_pipeline_en.md new file mode 100644 index 00000000000000..d7c47cb2fea65c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_bible_adv_instruction_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_bible_adv_instruction_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_bible_adv_instruction_0_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_bible_adv_instruction_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_bible_adv_instruction_0_pipeline_en_5.4.2_3.0_1724341045413.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_bible_adv_instruction_0_pipeline_en_5.4.2_3.0_1724341045413.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_bible_adv_instruction_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_bible_adv_instruction_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_bible_adv_instruction_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_bible_adv_instruction_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_rare_word_cf_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_rare_word_cf_2_en.md new file mode 100644 index 00000000000000..90be944e40c89a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_rare_word_cf_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_rare_word_cf_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_rare_word_cf_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_rare_word_cf_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_rare_word_cf_2_en_5.4.2_3.0_1724340265178.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_rare_word_cf_2_en_5.4.2_3.0_1724340265178.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_rare_word_cf_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_rare_word_cf_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_rare_word_cf_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_rare_word_cf_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_rare_word_cf_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_rare_word_cf_2_pipeline_en.md new file mode 100644 index 00000000000000..ea844bfb1eb036 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-t5large_tweet_emotion_rare_word_cf_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_rare_word_cf_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_rare_word_cf_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_rare_word_cf_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_rare_word_cf_2_pipeline_en_5.4.2_3.0_1724340403008.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_rare_word_cf_2_pipeline_en_5.4.2_3.0_1724340403008.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_rare_word_cf_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_rare_word_cf_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_rare_word_cf_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_rare_word_cf_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-tanl_based_materialsmine_ner_re_multitask_en.md b/docs/_posts/ahmedlone127/2024-08-22-tanl_based_materialsmine_ner_re_multitask_en.md new file mode 100644 index 00000000000000..5538f211fa3c0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-tanl_based_materialsmine_ner_re_multitask_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tanl_based_materialsmine_ner_re_multitask T5Transformer from bingyinh +author: John Snow Labs +name: tanl_based_materialsmine_ner_re_multitask +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tanl_based_materialsmine_ner_re_multitask` is a English model originally trained by bingyinh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tanl_based_materialsmine_ner_re_multitask_en_5.4.2_3.0_1724295304480.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tanl_based_materialsmine_ner_re_multitask_en_5.4.2_3.0_1724295304480.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tanl_based_materialsmine_ner_re_multitask","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tanl_based_materialsmine_ner_re_multitask", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tanl_based_materialsmine_ner_re_multitask| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bingyinh/TANL-based_MaterialsMine_NER_RE_Multitask \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-tanl_based_materialsmine_ner_re_multitask_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-tanl_based_materialsmine_ner_re_multitask_pipeline_en.md new file mode 100644 index 00000000000000..aa08d15f6b6674 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-tanl_based_materialsmine_ner_re_multitask_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tanl_based_materialsmine_ner_re_multitask_pipeline pipeline T5Transformer from bingyinh +author: John Snow Labs +name: tanl_based_materialsmine_ner_re_multitask_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tanl_based_materialsmine_ner_re_multitask_pipeline` is a English model originally trained by bingyinh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tanl_based_materialsmine_ner_re_multitask_pipeline_en_5.4.2_3.0_1724295351236.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tanl_based_materialsmine_ner_re_multitask_pipeline_en_5.4.2_3.0_1724295351236.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tanl_based_materialsmine_ner_re_multitask_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tanl_based_materialsmine_ner_re_multitask_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tanl_based_materialsmine_ner_re_multitask_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/bingyinh/TANL-based_MaterialsMine_NER_RE_Multitask + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_iirc_retrieved_en.md b/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_iirc_retrieved_en.md new file mode 100644 index 00000000000000..4711898a246bf5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_iirc_retrieved_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English teabreac_nt5_small_iirc_retrieved T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_nt5_small_iirc_retrieved +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_nt5_small_iirc_retrieved` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_iirc_retrieved_en_5.4.2_3.0_1724324011828.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_iirc_retrieved_en_5.4.2_3.0_1724324011828.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("teabreac_nt5_small_iirc_retrieved","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("teabreac_nt5_small_iirc_retrieved", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_nt5_small_iirc_retrieved| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-nt5-small-iirc-retrieved \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_iirc_retrieved_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_iirc_retrieved_pipeline_en.md new file mode 100644 index 00000000000000..5e3aa399303d09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_iirc_retrieved_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English teabreac_nt5_small_iirc_retrieved_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_nt5_small_iirc_retrieved_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_nt5_small_iirc_retrieved_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_iirc_retrieved_pipeline_en_5.4.2_3.0_1724324029473.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_iirc_retrieved_pipeline_en_5.4.2_3.0_1724324029473.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("teabreac_nt5_small_iirc_retrieved_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("teabreac_nt5_small_iirc_retrieved_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_nt5_small_iirc_retrieved_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-nt5-small-iirc-retrieved + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_numglue_en.md b/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_numglue_en.md new file mode 100644 index 00000000000000..0dea43f85b98a1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_numglue_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English teabreac_nt5_small_numglue T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_nt5_small_numglue +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_nt5_small_numglue` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_numglue_en_5.4.2_3.0_1724300086433.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_numglue_en_5.4.2_3.0_1724300086433.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("teabreac_nt5_small_numglue","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("teabreac_nt5_small_numglue", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_nt5_small_numglue| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.9 MB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-nt5-small-numglue \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_numglue_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_numglue_pipeline_en.md new file mode 100644 index 00000000000000..306faac4e6725f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-teabreac_nt5_small_numglue_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English teabreac_nt5_small_numglue_pipeline pipeline T5Transformer from StonyBrookNLP +author: John Snow Labs +name: teabreac_nt5_small_numglue_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`teabreac_nt5_small_numglue_pipeline` is a English model originally trained by StonyBrookNLP. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_numglue_pipeline_en_5.4.2_3.0_1724300103138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/teabreac_nt5_small_numglue_pipeline_en_5.4.2_3.0_1724300103138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("teabreac_nt5_small_numglue_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("teabreac_nt5_small_numglue_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|teabreac_nt5_small_numglue_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.9 MB| + +## References + +https://huggingface.co/StonyBrookNLP/teabreac-nt5-small-numglue + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-test_rulec_nvp5000_en.md b/docs/_posts/ahmedlone127/2024-08-22-test_rulec_nvp5000_en.md new file mode 100644 index 00000000000000..3f2fd917c7b366 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-test_rulec_nvp5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_rulec_nvp5000 T5Transformer from mika5883 +author: John Snow Labs +name: test_rulec_nvp5000 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_rulec_nvp5000` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_rulec_nvp5000_en_5.4.2_3.0_1724370538367.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_rulec_nvp5000_en_5.4.2_3.0_1724370538367.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_rulec_nvp5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_rulec_nvp5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_rulec_nvp5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/TEST_RULEC_NVP5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-test_rulec_nvp5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-test_rulec_nvp5000_pipeline_en.md new file mode 100644 index 00000000000000..205d15e19530b2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-test_rulec_nvp5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_rulec_nvp5000_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: test_rulec_nvp5000_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_rulec_nvp5000_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_rulec_nvp5000_pipeline_en_5.4.2_3.0_1724370585819.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_rulec_nvp5000_pipeline_en_5.4.2_3.0_1724370585819.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_rulec_nvp5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_rulec_nvp5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_rulec_nvp5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/TEST_RULEC_NVP5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-test_t5_cnn_dailymail_en.md b/docs/_posts/ahmedlone127/2024-08-22-test_t5_cnn_dailymail_en.md new file mode 100644 index 00000000000000..d0313b212fbd32 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-test_t5_cnn_dailymail_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English test_t5_cnn_dailymail T5Transformer from robdemunck +author: John Snow Labs +name: test_t5_cnn_dailymail +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_t5_cnn_dailymail` is a English model originally trained by robdemunck. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_t5_cnn_dailymail_en_5.4.2_3.0_1724329454150.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_t5_cnn_dailymail_en_5.4.2_3.0_1724329454150.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("test_t5_cnn_dailymail","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("test_t5_cnn_dailymail", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_t5_cnn_dailymail| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.7 MB| + +## References + +https://huggingface.co/robdemunck/test-t5-cnn_dailymail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-test_t5_cnn_dailymail_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-test_t5_cnn_dailymail_pipeline_en.md new file mode 100644 index 00000000000000..89af6f8f378eec --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-test_t5_cnn_dailymail_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English test_t5_cnn_dailymail_pipeline pipeline T5Transformer from robdemunck +author: John Snow Labs +name: test_t5_cnn_dailymail_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`test_t5_cnn_dailymail_pipeline` is a English model originally trained by robdemunck. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/test_t5_cnn_dailymail_pipeline_en_5.4.2_3.0_1724329475835.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/test_t5_cnn_dailymail_pipeline_en_5.4.2_3.0_1724329475835.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("test_t5_cnn_dailymail_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("test_t5_cnn_dailymail_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|test_t5_cnn_dailymail_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.7 MB| + +## References + +https://huggingface.co/robdemunck/test-t5-cnn_dailymail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-testvalue_t5_model2_en.md b/docs/_posts/ahmedlone127/2024-08-22-testvalue_t5_model2_en.md new file mode 100644 index 00000000000000..81d55c66f69d26 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-testvalue_t5_model2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English testvalue_t5_model2 T5Transformer from tanvirsrbd1 +author: John Snow Labs +name: testvalue_t5_model2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`testvalue_t5_model2` is a English model originally trained by tanvirsrbd1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/testvalue_t5_model2_en_5.4.2_3.0_1724371137963.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/testvalue_t5_model2_en_5.4.2_3.0_1724371137963.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("testvalue_t5_model2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("testvalue_t5_model2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|testvalue_t5_model2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tanvirsrbd1/testvalue_t5_model2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-testvalue_t5_model2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-testvalue_t5_model2_pipeline_en.md new file mode 100644 index 00000000000000..af5ca39b8fbd06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-testvalue_t5_model2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English testvalue_t5_model2_pipeline pipeline T5Transformer from tanvirsrbd1 +author: John Snow Labs +name: testvalue_t5_model2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`testvalue_t5_model2_pipeline` is a English model originally trained by tanvirsrbd1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/testvalue_t5_model2_pipeline_en_5.4.2_3.0_1724371188102.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/testvalue_t5_model2_pipeline_en_5.4.2_3.0_1724371188102.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("testvalue_t5_model2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("testvalue_t5_model2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|testvalue_t5_model2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tanvirsrbd1/testvalue_t5_model2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text2text_sparql_en.md b/docs/_posts/ahmedlone127/2024-08-22-text2text_sparql_en.md new file mode 100644 index 00000000000000..40599a48b40f27 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text2text_sparql_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text2text_sparql T5Transformer from Jerfey +author: John Snow Labs +name: text2text_sparql +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2text_sparql` is a English model originally trained by Jerfey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2text_sparql_en_5.4.2_3.0_1724328306914.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2text_sparql_en_5.4.2_3.0_1724328306914.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text2text_sparql","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text2text_sparql", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2text_sparql| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|291.7 MB| + +## References + +https://huggingface.co/Jerfey/text2text_sparql \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text2text_sparql_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-text2text_sparql_pipeline_en.md new file mode 100644 index 00000000000000..bdebca7b5a6123 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text2text_sparql_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text2text_sparql_pipeline pipeline T5Transformer from Jerfey +author: John Snow Labs +name: text2text_sparql_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text2text_sparql_pipeline` is a English model originally trained by Jerfey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text2text_sparql_pipeline_en_5.4.2_3.0_1724328340069.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text2text_sparql_pipeline_en_5.4.2_3.0_1724328340069.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text2text_sparql_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text2text_sparql_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text2text_sparql_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|291.7 MB| + +## References + +https://huggingface.co/Jerfey/text2text_sparql + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_exps_qa_t5_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_exps_qa_t5_en.md new file mode 100644 index 00000000000000..069efddfe2a582 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_exps_qa_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_exps_qa_t5 T5Transformer from james-burton +author: John Snow Labs +name: text_exps_qa_t5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_exps_qa_t5` is a English model originally trained by james-burton. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_exps_qa_t5_en_5.4.2_3.0_1724338182716.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_exps_qa_t5_en_5.4.2_3.0_1724338182716.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_exps_qa_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_exps_qa_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_exps_qa_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|926.9 MB| + +## References + +https://huggingface.co/james-burton/text-exps-qa-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_exps_qa_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_exps_qa_t5_pipeline_en.md new file mode 100644 index 00000000000000..e7509e1700282a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_exps_qa_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_exps_qa_t5_pipeline pipeline T5Transformer from james-burton +author: John Snow Labs +name: text_exps_qa_t5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_exps_qa_t5_pipeline` is a English model originally trained by james-burton. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_exps_qa_t5_pipeline_en_5.4.2_3.0_1724338233496.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_exps_qa_t5_pipeline_en_5.4.2_3.0_1724338233496.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_exps_qa_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_exps_qa_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_exps_qa_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|926.9 MB| + +## References + +https://huggingface.co/james-burton/text-exps-qa-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_exps_t5_large_10_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_exps_t5_large_10_en.md new file mode 100644 index 00000000000000..92301f41b64561 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_exps_t5_large_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_exps_t5_large_10 T5Transformer from james-burton +author: John Snow Labs +name: text_exps_t5_large_10 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_exps_t5_large_10` is a English model originally trained by james-burton. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_exps_t5_large_10_en_5.4.2_3.0_1724328610508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_exps_t5_large_10_en_5.4.2_3.0_1724328610508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_exps_t5_large_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_exps_t5_large_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_exps_t5_large_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/james-burton/text-exps-t5-large-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_exps_t5_large_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_exps_t5_large_10_pipeline_en.md new file mode 100644 index 00000000000000..f94c0ea1171a4d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_exps_t5_large_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_exps_t5_large_10_pipeline pipeline T5Transformer from james-burton +author: John Snow Labs +name: text_exps_t5_large_10_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_exps_t5_large_10_pipeline` is a English model originally trained by james-burton. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_exps_t5_large_10_pipeline_en_5.4.2_3.0_1724328769326.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_exps_t5_large_10_pipeline_en_5.4.2_3.0_1724328769326.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_exps_t5_large_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_exps_t5_large_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_exps_t5_large_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/james-burton/text-exps-t5-large-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v18_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v18_en.md new file mode 100644 index 00000000000000..555af59c313161 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v18_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v18 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v18 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v18` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v18_en_5.4.2_3.0_1724308720152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v18_en_5.4.2_3.0_1724308720152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v18","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v18", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v18| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|320.0 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v18 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v18_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v18_pipeline_en.md new file mode 100644 index 00000000000000..05f6f03d0681ba --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v18_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v18_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v18_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v18_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v18_pipeline_en_5.4.2_3.0_1724308740193.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v18_pipeline_en_5.4.2_3.0_1724308740193.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v18_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v18_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v18_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|320.0 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v18 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v63_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v63_en.md new file mode 100644 index 00000000000000..d464d85ec15d35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v63_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v63 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v63 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v63` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v63_en_5.4.2_3.0_1724286727783.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v63_en_5.4.2_3.0_1724286727783.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v63","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v63", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v63| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.4 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v63 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v63_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v63_pipeline_en.md new file mode 100644 index 00000000000000..babd9edbcb4131 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v63_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v63_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v63_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v63_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v63_pipeline_en_5.4.2_3.0_1724286748420.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v63_pipeline_en_5.4.2_3.0_1724286748420.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v63_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v63_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v63_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.4 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v63 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v77_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v77_en.md new file mode 100644 index 00000000000000..fb209fa6e0f508 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v77_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v77 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v77 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v77` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v77_en_5.4.2_3.0_1724324985046.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v77_en_5.4.2_3.0_1724324985046.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v77","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v77", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v77| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.0 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v77 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v77_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v77_pipeline_en.md new file mode 100644 index 00000000000000..29daacf38c7926 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-text_shortening_model_v77_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v77_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v77_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v77_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v77_pipeline_en_5.4.2_3.0_1724325007987.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v77_pipeline_en_5.4.2_3.0_1724325007987.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v77_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v77_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v77_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.0 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v77 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-textsummarizerai_basic_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-textsummarizerai_basic_v1_en.md new file mode 100644 index 00000000000000..f33545ea5f2c31 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-textsummarizerai_basic_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English textsummarizerai_basic_v1 T5Transformer from Bhotuya +author: John Snow Labs +name: textsummarizerai_basic_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`textsummarizerai_basic_v1` is a English model originally trained by Bhotuya. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/textsummarizerai_basic_v1_en_5.4.2_3.0_1724311623720.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/textsummarizerai_basic_v1_en_5.4.2_3.0_1724311623720.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("textsummarizerai_basic_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("textsummarizerai_basic_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|textsummarizerai_basic_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.0 MB| + +## References + +https://huggingface.co/Bhotuya/TextSummarizerAI_Basic_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-textsummarizerai_basic_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-textsummarizerai_basic_v1_pipeline_en.md new file mode 100644 index 00000000000000..c2061dd54b040d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-textsummarizerai_basic_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English textsummarizerai_basic_v1_pipeline pipeline T5Transformer from Bhotuya +author: John Snow Labs +name: textsummarizerai_basic_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`textsummarizerai_basic_v1_pipeline` is a English model originally trained by Bhotuya. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/textsummarizerai_basic_v1_pipeline_en_5.4.2_3.0_1724311644493.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/textsummarizerai_basic_v1_pipeline_en_5.4.2_3.0_1724311644493.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("textsummarizerai_basic_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("textsummarizerai_basic_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|textsummarizerai_basic_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.0 MB| + +## References + +https://huggingface.co/Bhotuya/TextSummarizerAI_Basic_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-tmp004_en.md b/docs/_posts/ahmedlone127/2024-08-22-tmp004_en.md new file mode 100644 index 00000000000000..a5ab7eaa347f4f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-tmp004_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English tmp004 T5Transformer from jinfwhuang +author: John Snow Labs +name: tmp004 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tmp004` is a English model originally trained by jinfwhuang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tmp004_en_5.4.2_3.0_1724328091465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tmp004_en_5.4.2_3.0_1724328091465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("tmp004","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("tmp004", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tmp004| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/jinfwhuang/tmp004 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-tmp004_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-tmp004_pipeline_en.md new file mode 100644 index 00000000000000..663a3356963bc7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-tmp004_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English tmp004_pipeline pipeline T5Transformer from jinfwhuang +author: John Snow Labs +name: tmp004_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`tmp004_pipeline` is a English model originally trained by jinfwhuang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/tmp004_pipeline_en_5.4.2_3.0_1724328107981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/tmp004_pipeline_en_5.4.2_3.0_1724328107981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("tmp004_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("tmp004_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|tmp004_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/jinfwhuang/tmp004 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v1_en.md b/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v1_en.md new file mode 100644 index 00000000000000..bdd990594d8468 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English train_own_t5_v1 T5Transformer from Soniq +author: John Snow Labs +name: train_own_t5_v1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`train_own_t5_v1` is a English model originally trained by Soniq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/train_own_t5_v1_en_5.4.2_3.0_1724307515137.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/train_own_t5_v1_en_5.4.2_3.0_1724307515137.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("train_own_t5_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("train_own_t5_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|train_own_t5_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Soniq/train_own_t5_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v1_pipeline_en.md new file mode 100644 index 00000000000000..40c10f1b8682ad --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English train_own_t5_v1_pipeline pipeline T5Transformer from Soniq +author: John Snow Labs +name: train_own_t5_v1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`train_own_t5_v1_pipeline` is a English model originally trained by Soniq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/train_own_t5_v1_pipeline_en_5.4.2_3.0_1724307562579.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/train_own_t5_v1_pipeline_en_5.4.2_3.0_1724307562579.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("train_own_t5_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("train_own_t5_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|train_own_t5_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Soniq/train_own_t5_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v2_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v2_small_en.md new file mode 100644 index 00000000000000..4a83c38f3a2873 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v2_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English train_own_t5_v2_small T5Transformer from Soniq +author: John Snow Labs +name: train_own_t5_v2_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`train_own_t5_v2_small` is a English model originally trained by Soniq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/train_own_t5_v2_small_en_5.4.2_3.0_1724301529449.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/train_own_t5_v2_small_en_5.4.2_3.0_1724301529449.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("train_own_t5_v2_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("train_own_t5_v2_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|train_own_t5_v2_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/Soniq/train_own_t5_v2_small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v2_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v2_small_pipeline_en.md new file mode 100644 index 00000000000000..c47cbcbb86de61 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-train_own_t5_v2_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English train_own_t5_v2_small_pipeline pipeline T5Transformer from Soniq +author: John Snow Labs +name: train_own_t5_v2_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`train_own_t5_v2_small_pipeline` is a English model originally trained by Soniq. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/train_own_t5_v2_small_pipeline_en_5.4.2_3.0_1724301546280.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/train_own_t5_v2_small_pipeline_en_5.4.2_3.0_1724301546280.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("train_own_t5_v2_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("train_own_t5_v2_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|train_own_t5_v2_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/Soniq/train_own_t5_v2_small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_base_sft_rl_en.md b/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_base_sft_rl_en.md new file mode 100644 index 00000000000000..1a1c13978ee679 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_base_sft_rl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English trlx_flan_t5_base_sft_rl T5Transformer from papersubmission +author: John Snow Labs +name: trlx_flan_t5_base_sft_rl +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`trlx_flan_t5_base_sft_rl` is a English model originally trained by papersubmission. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_base_sft_rl_en_5.4.2_3.0_1724286169911.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_base_sft_rl_en_5.4.2_3.0_1724286169911.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("trlx_flan_t5_base_sft_rl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("trlx_flan_t5_base_sft_rl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|trlx_flan_t5_base_sft_rl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.4 MB| + +## References + +https://huggingface.co/papersubmission/trlx_flan_t5_base_sft_rl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_base_sft_rl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_base_sft_rl_pipeline_en.md new file mode 100644 index 00000000000000..a088a566bfcdbe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_base_sft_rl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English trlx_flan_t5_base_sft_rl_pipeline pipeline T5Transformer from papersubmission +author: John Snow Labs +name: trlx_flan_t5_base_sft_rl_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`trlx_flan_t5_base_sft_rl_pipeline` is a English model originally trained by papersubmission. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_base_sft_rl_pipeline_en_5.4.2_3.0_1724286343880.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_base_sft_rl_pipeline_en_5.4.2_3.0_1724286343880.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("trlx_flan_t5_base_sft_rl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("trlx_flan_t5_base_sft_rl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|trlx_flan_t5_base_sft_rl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.4 MB| + +## References + +https://huggingface.co/papersubmission/trlx_flan_t5_base_sft_rl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_small_sft_rl_en.md b/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_small_sft_rl_en.md new file mode 100644 index 00000000000000..a9eb8ad6a4108c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_small_sft_rl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English trlx_flan_t5_small_sft_rl T5Transformer from papersubmission +author: John Snow Labs +name: trlx_flan_t5_small_sft_rl +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`trlx_flan_t5_small_sft_rl` is a English model originally trained by papersubmission. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_small_sft_rl_en_5.4.2_3.0_1724365900439.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_small_sft_rl_en_5.4.2_3.0_1724365900439.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("trlx_flan_t5_small_sft_rl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("trlx_flan_t5_small_sft_rl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|trlx_flan_t5_small_sft_rl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/papersubmission/trlx_flan_t5_small_sft_rl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_small_sft_rl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_small_sft_rl_pipeline_en.md new file mode 100644 index 00000000000000..b6b94889b4ee58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-trlx_flan_t5_small_sft_rl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English trlx_flan_t5_small_sft_rl_pipeline pipeline T5Transformer from papersubmission +author: John Snow Labs +name: trlx_flan_t5_small_sft_rl_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`trlx_flan_t5_small_sft_rl_pipeline` is a English model originally trained by papersubmission. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_small_sft_rl_pipeline_en_5.4.2_3.0_1724365962359.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_small_sft_rl_pipeline_en_5.4.2_3.0_1724365962359.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("trlx_flan_t5_small_sft_rl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("trlx_flan_t5_small_sft_rl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|trlx_flan_t5_small_sft_rl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/papersubmission/trlx_flan_t5_small_sft_rl + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-turkish_mt5_en.md b/docs/_posts/ahmedlone127/2024-08-22-turkish_mt5_en.md new file mode 100644 index 00000000000000..7957963ab2857d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-turkish_mt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkish_mt5 T5Transformer from Enes3774 +author: John Snow Labs +name: turkish_mt5 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkish_mt5` is a English model originally trained by Enes3774. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkish_mt5_en_5.4.2_3.0_1724363981919.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkish_mt5_en_5.4.2_3.0_1724363981919.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkish_mt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkish_mt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkish_mt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|410.5 MB| + +## References + +https://huggingface.co/Enes3774/tr_mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-turkish_mt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-turkish_mt5_pipeline_en.md new file mode 100644 index 00000000000000..27286e0f201c8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-turkish_mt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkish_mt5_pipeline pipeline T5Transformer from Enes3774 +author: John Snow Labs +name: turkish_mt5_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkish_mt5_pipeline` is a English model originally trained by Enes3774. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkish_mt5_pipeline_en_5.4.2_3.0_1724364013368.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkish_mt5_pipeline_en_5.4.2_3.0_1724364013368.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkish_mt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkish_mt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkish_mt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|410.5 MB| + +## References + +https://huggingface.co/Enes3774/tr_mt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_large_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_large_2_en.md new file mode 100644 index 00000000000000..34522119d37008 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_large_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_squad_large_2 T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_large_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_large_2` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_large_2_en_5.4.2_3.0_1724340731742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_large_2_en_5.4.2_3.0_1724340731742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_squad_large_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_squad_large_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_large_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-large-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_small_2_en.md b/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_small_2_en.md new file mode 100644 index 00000000000000..427464131bf7dc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_small_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English turkmen_instruct_squad_small_2 T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_small_2 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_small_2` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_2_en_5.4.2_3.0_1724352500830.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_2_en_5.4.2_3.0_1724352500830.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("turkmen_instruct_squad_small_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("turkmen_instruct_squad_small_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_small_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-small-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_small_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_small_2_pipeline_en.md new file mode 100644 index 00000000000000..5c179830050812 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-turkmen_instruct_squad_small_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English turkmen_instruct_squad_small_2_pipeline pipeline T5Transformer from jacobmorrison +author: John Snow Labs +name: turkmen_instruct_squad_small_2_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`turkmen_instruct_squad_small_2_pipeline` is a English model originally trained by jacobmorrison. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_2_pipeline_en_5.4.2_3.0_1724352562863.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/turkmen_instruct_squad_small_2_pipeline_en_5.4.2_3.0_1724352562863.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("turkmen_instruct_squad_small_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("turkmen_instruct_squad_small_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|turkmen_instruct_squad_small_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.0 MB| + +## References + +https://huggingface.co/jacobmorrison/tk-instruct-squad-small-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-unifiedqa_cbs_en.md b/docs/_posts/ahmedlone127/2024-08-22-unifiedqa_cbs_en.md new file mode 100644 index 00000000000000..5ec25b22e9dcbd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-unifiedqa_cbs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English unifiedqa_cbs T5Transformer from varunlpai +author: John Snow Labs +name: unifiedqa_cbs +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unifiedqa_cbs` is a English model originally trained by varunlpai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unifiedqa_cbs_en_5.4.2_3.0_1724320097241.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unifiedqa_cbs_en_5.4.2_3.0_1724320097241.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("unifiedqa_cbs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("unifiedqa_cbs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unifiedqa_cbs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/varunlpai/unifiedqa-cbs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-unifiedqa_cbs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-unifiedqa_cbs_pipeline_en.md new file mode 100644 index 00000000000000..7597b3a037cc3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-unifiedqa_cbs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English unifiedqa_cbs_pipeline pipeline T5Transformer from varunlpai +author: John Snow Labs +name: unifiedqa_cbs_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`unifiedqa_cbs_pipeline` is a English model originally trained by varunlpai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/unifiedqa_cbs_pipeline_en_5.4.2_3.0_1724320241351.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/unifiedqa_cbs_pipeline_en_5.4.2_3.0_1724320241351.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("unifiedqa_cbs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("unifiedqa_cbs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|unifiedqa_cbs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/varunlpai/unifiedqa-cbs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-verbs_mem_small_en.md b/docs/_posts/ahmedlone127/2024-08-22-verbs_mem_small_en.md new file mode 100644 index 00000000000000..dfebdc5c92e91c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-verbs_mem_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English verbs_mem_small T5Transformer from eddieman78 +author: John Snow Labs +name: verbs_mem_small +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`verbs_mem_small` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/verbs_mem_small_en_5.4.2_3.0_1724370938129.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/verbs_mem_small_en_5.4.2_3.0_1724370938129.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("verbs_mem_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("verbs_mem_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|verbs_mem_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/eddieman78/verbs-mem-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-verbs_mem_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-verbs_mem_small_pipeline_en.md new file mode 100644 index 00000000000000..cd9df1bffeecd8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-verbs_mem_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English verbs_mem_small_pipeline pipeline T5Transformer from eddieman78 +author: John Snow Labs +name: verbs_mem_small_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`verbs_mem_small_pipeline` is a English model originally trained by eddieman78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/verbs_mem_small_pipeline_en_5.4.2_3.0_1724370954879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/verbs_mem_small_pipeline_en_5.4.2_3.0_1724370954879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("verbs_mem_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("verbs_mem_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|verbs_mem_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/eddieman78/verbs-mem-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietai_english_vietnamese_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietai_english_vietnamese_en.md new file mode 100644 index 00000000000000..ccb5dd39079c88 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietai_english_vietnamese_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietai_english_vietnamese T5Transformer from hungphongtrn +author: John Snow Labs +name: vietai_english_vietnamese +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietai_english_vietnamese` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietai_english_vietnamese_en_5.4.2_3.0_1724335992877.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietai_english_vietnamese_en_5.4.2_3.0_1724335992877.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietai_english_vietnamese","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietai_english_vietnamese", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietai_english_vietnamese| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vietai_en_vi \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietai_english_vietnamese_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietai_english_vietnamese_pipeline_en.md new file mode 100644 index 00000000000000..87c7d092f6aeac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietai_english_vietnamese_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietai_english_vietnamese_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietai_english_vietnamese_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietai_english_vietnamese_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietai_english_vietnamese_pipeline_en_5.4.2_3.0_1724336060152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietai_english_vietnamese_pipeline_en_5.4.2_3.0_1724336060152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietai_english_vietnamese_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietai_english_vietnamese_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietai_english_vietnamese_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vietai_en_vi + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_half_doc_news_train_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_half_doc_news_train_en.md new file mode 100644 index 00000000000000..720108850c3b6b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_half_doc_news_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_envit5_base_half_doc_news_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_base_half_doc_news_train +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_base_half_doc_news_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_half_doc_news_train_en_5.4.2_3.0_1724356183422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_half_doc_news_train_en_5.4.2_3.0_1724356183422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_envit5_base_half_doc_news_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_envit5_base_half_doc_news_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_base_half_doc_news_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-base_half_doc_news_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_half_doc_news_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_half_doc_news_train_pipeline_en.md new file mode 100644 index 00000000000000..0db191a2cd55d6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_half_doc_news_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_envit5_base_half_doc_news_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_base_half_doc_news_train_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_base_half_doc_news_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_half_doc_news_train_pipeline_en_5.4.2_3.0_1724356256599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_half_doc_news_train_pipeline_en_5.4.2_3.0_1724356256599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_envit5_base_half_doc_news_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_envit5_base_half_doc_news_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_base_half_doc_news_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-base_half_doc_news_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_news_train_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_news_train_en.md new file mode 100644 index 00000000000000..e4c9359951476e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_news_train_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_english_envit5_base_news_train T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_base_news_train +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_base_news_train` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_news_train_en_5.4.2_3.0_1724346953334.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_news_train_en_5.4.2_3.0_1724346953334.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_english_envit5_base_news_train","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_english_envit5_base_news_train", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_base_news_train| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-base_news_train \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_news_train_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_news_train_pipeline_en.md new file mode 100644 index 00000000000000..1bb68f0cdcbb29 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_english_envit5_base_news_train_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_english_envit5_base_news_train_pipeline pipeline T5Transformer from hungphongtrn +author: John Snow Labs +name: vietnamese_english_envit5_base_news_train_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_english_envit5_base_news_train_pipeline` is a English model originally trained by hungphongtrn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_news_train_pipeline_en_5.4.2_3.0_1724347026724.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_english_envit5_base_news_train_pipeline_en_5.4.2_3.0_1724347026724.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_english_envit5_base_news_train_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_english_envit5_base_news_train_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_english_envit5_base_news_train_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/hungphongtrn/vi_en_envit5-base_news_train + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietnamese_k2t_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_k2t_en.md new file mode 100644 index 00000000000000..b7f5bf1acfdc0d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_k2t_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnamese_k2t T5Transformer from khoanvm +author: John Snow Labs +name: vietnamese_k2t +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_k2t` is a English model originally trained by khoanvm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_k2t_en_5.4.2_3.0_1724311722063.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_k2t_en_5.4.2_3.0_1724311722063.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnamese_k2t","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnamese_k2t", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_k2t| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/khoanvm/vi-k2t \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietnamese_k2t_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_k2t_pipeline_en.md new file mode 100644 index 00000000000000..fe4970e79eabe3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietnamese_k2t_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnamese_k2t_pipeline pipeline T5Transformer from khoanvm +author: John Snow Labs +name: vietnamese_k2t_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnamese_k2t_pipeline` is a English model originally trained by khoanvm. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnamese_k2t_pipeline_en_5.4.2_3.0_1724311771986.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnamese_k2t_pipeline_en_5.4.2_3.0_1724311771986.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnamese_k2t_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnamese_k2t_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnamese_k2t_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/khoanvm/vi-k2t + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietnews_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietnews_summarization_en.md new file mode 100644 index 00000000000000..0cce684b31e55e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietnews_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vietnews_summarization T5Transformer from thaonh +author: John Snow Labs +name: vietnews_summarization +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnews_summarization` is a English model originally trained by thaonh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnews_summarization_en_5.4.2_3.0_1724302613356.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnews_summarization_en_5.4.2_3.0_1724302613356.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vietnews_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vietnews_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnews_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/thaonh/vietnews-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vietnews_summarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vietnews_summarization_pipeline_en.md new file mode 100644 index 00000000000000..53e027773f10a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vietnews_summarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vietnews_summarization_pipeline pipeline T5Transformer from thaonh +author: John Snow Labs +name: vietnews_summarization_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vietnews_summarization_pipeline` is a English model originally trained by thaonh. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vietnews_summarization_pipeline_en_5.4.2_3.0_1724302835479.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vietnews_summarization_pipeline_en_5.4.2_3.0_1724302835479.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vietnews_summarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vietnews_summarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vietnews_summarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/thaonh/vietnews-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_base_finetuned_vn_honganhle_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_finetuned_vn_honganhle_en.md new file mode 100644 index 00000000000000..175eb344dfd7e5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_finetuned_vn_honganhle_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_finetuned_vn_honganhle T5Transformer from honganhle +author: John Snow Labs +name: vit5_base_finetuned_vn_honganhle +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_finetuned_vn_honganhle` is a English model originally trained by honganhle. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_honganhle_en_5.4.2_3.0_1724318985286.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_honganhle_en_5.4.2_3.0_1724318985286.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_finetuned_vn_honganhle","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_finetuned_vn_honganhle", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_finetuned_vn_honganhle| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/honganhle/vit5-base-finetuned-VN \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_base_finetuned_vn_honganhle_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_finetuned_vn_honganhle_pipeline_en.md new file mode 100644 index 00000000000000..85d7e80948ea18 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_finetuned_vn_honganhle_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_finetuned_vn_honganhle_pipeline pipeline T5Transformer from honganhle +author: John Snow Labs +name: vit5_base_finetuned_vn_honganhle_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_finetuned_vn_honganhle_pipeline` is a English model originally trained by honganhle. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_honganhle_pipeline_en_5.4.2_3.0_1724319034780.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_finetuned_vn_honganhle_pipeline_en_5.4.2_3.0_1724319034780.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_finetuned_vn_honganhle_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_finetuned_vn_honganhle_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_finetuned_vn_honganhle_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/honganhle/vit5-base-finetuned-VN + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnamese_question_paraphrasing_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnamese_question_paraphrasing_en.md new file mode 100644 index 00000000000000..02e8b37c6d7c66 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnamese_question_paraphrasing_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_vietnamese_question_paraphrasing T5Transformer from ngwgsang +author: John Snow Labs +name: vit5_base_vietnamese_question_paraphrasing +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnamese_question_paraphrasing` is a English model originally trained by ngwgsang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnamese_question_paraphrasing_en_5.4.2_3.0_1724340962999.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnamese_question_paraphrasing_en_5.4.2_3.0_1724340962999.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_vietnamese_question_paraphrasing","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_vietnamese_question_paraphrasing", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnamese_question_paraphrasing| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ngwgsang/vit5-base-vietnamese-question-paraphrasing \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnamese_question_paraphrasing_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnamese_question_paraphrasing_pipeline_en.md new file mode 100644 index 00000000000000..37e7e4ba991546 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnamese_question_paraphrasing_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_vietnamese_question_paraphrasing_pipeline pipeline T5Transformer from ngwgsang +author: John Snow Labs +name: vit5_base_vietnamese_question_paraphrasing_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnamese_question_paraphrasing_pipeline` is a English model originally trained by ngwgsang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnamese_question_paraphrasing_pipeline_en_5.4.2_3.0_1724341024495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnamese_question_paraphrasing_pipeline_en_5.4.2_3.0_1724341024495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_vietnamese_question_paraphrasing_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_vietnamese_question_paraphrasing_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnamese_question_paraphrasing_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ngwgsang/vit5-base-vietnamese-question-paraphrasing + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_finetuned_vn_honganhle_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_finetuned_vn_honganhle_en.md new file mode 100644 index 00000000000000..85f7634a3edb83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_finetuned_vn_honganhle_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_vietnews_summarization_finetuned_vn_honganhle T5Transformer from honganhle +author: John Snow Labs +name: vit5_base_vietnews_summarization_finetuned_vn_honganhle +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnews_summarization_finetuned_vn_honganhle` is a English model originally trained by honganhle. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_honganhle_en_5.4.2_3.0_1724311928552.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_honganhle_en_5.4.2_3.0_1724311928552.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_vietnews_summarization_finetuned_vn_honganhle","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_vietnews_summarization_finetuned_vn_honganhle", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnews_summarization_finetuned_vn_honganhle| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/honganhle/vit5-base-vietnews-summarization-finetuned-VN \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline_en.md new file mode 100644 index 00000000000000..aa0171bce965f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline pipeline T5Transformer from honganhle +author: John Snow Labs +name: vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline` is a English model originally trained by honganhle. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline_en_5.4.2_3.0_1724311978223.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline_en_5.4.2_3.0_1724311978223.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnews_summarization_finetuned_vn_honganhle_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/honganhle/vit5-base-vietnews-summarization-finetuned-VN + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_standardized_color_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_standardized_color_en.md new file mode 100644 index 00000000000000..ccc5644e1d5f76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_standardized_color_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_vietnews_summarization_standardized_color T5Transformer from ThuyNT03 +author: John Snow Labs +name: vit5_base_vietnews_summarization_standardized_color +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnews_summarization_standardized_color` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_standardized_color_en_5.4.2_3.0_1724285221484.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_standardized_color_en_5.4.2_3.0_1724285221484.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_vietnews_summarization_standardized_color","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_vietnews_summarization_standardized_color", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnews_summarization_standardized_color| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|967.8 MB| + +## References + +https://huggingface.co/ThuyNT03/vit5-base-vietnews-summarization-standardized-color \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_standardized_color_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_standardized_color_pipeline_en.md new file mode 100644 index 00000000000000..269944d09a6f08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_base_vietnews_summarization_standardized_color_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_vietnews_summarization_standardized_color_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: vit5_base_vietnews_summarization_standardized_color_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_vietnews_summarization_standardized_color_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_standardized_color_pipeline_en_5.4.2_3.0_1724285286545.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_vietnews_summarization_standardized_color_pipeline_en_5.4.2_3.0_1724285286545.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_vietnews_summarization_standardized_color_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_vietnews_summarization_standardized_color_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_vietnews_summarization_standardized_color_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|967.8 MB| + +## References + +https://huggingface.co/ThuyNT03/vit5-base-vietnews-summarization-standardized-color + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_comparative_only_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_comparative_only_en.md new file mode 100644 index 00000000000000..905ddaca36dbe5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_comparative_only_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_comparative_only T5Transformer from duyvu8373 +author: John Snow Labs +name: vit5_comparative_only +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_comparative_only` is a English model originally trained by duyvu8373. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_comparative_only_en_5.4.2_3.0_1724340018703.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_comparative_only_en_5.4.2_3.0_1724340018703.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_comparative_only","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_comparative_only", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_comparative_only| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/duyvu8373/viT5-comparative-only \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_comparative_only_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_comparative_only_pipeline_en.md new file mode 100644 index 00000000000000..67bb07600f82c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_comparative_only_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_comparative_only_pipeline pipeline T5Transformer from duyvu8373 +author: John Snow Labs +name: vit5_comparative_only_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_comparative_only_pipeline` is a English model originally trained by duyvu8373. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_comparative_only_pipeline_en_5.4.2_3.0_1724340079863.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_comparative_only_pipeline_en_5.4.2_3.0_1724340079863.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_comparative_only_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_comparative_only_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_comparative_only_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/duyvu8373/viT5-comparative-only + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_large_legal_lora_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_large_legal_lora_en.md new file mode 100644 index 00000000000000..4ed23c53ccf239 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_large_legal_lora_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_large_legal_lora T5Transformer from hduc-le +author: John Snow Labs +name: vit5_large_legal_lora +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_large_legal_lora` is a English model originally trained by hduc-le. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_large_legal_lora_en_5.4.2_3.0_1724314122963.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_large_legal_lora_en_5.4.2_3.0_1724314122963.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_large_legal_lora","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_large_legal_lora", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_large_legal_lora| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/hduc-le/vit5-large-legal-lora \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-vit5_large_legal_lora_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-vit5_large_legal_lora_pipeline_en.md new file mode 100644 index 00000000000000..2a002a8b2f4ace --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-vit5_large_legal_lora_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_large_legal_lora_pipeline pipeline T5Transformer from hduc-le +author: John Snow Labs +name: vit5_large_legal_lora_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_large_legal_lora_pipeline` is a English model originally trained by hduc-le. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_large_legal_lora_pipeline_en_5.4.2_3.0_1724314258571.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_large_legal_lora_pipeline_en_5.4.2_3.0_1724314258571.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_large_legal_lora_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_large_legal_lora_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_large_legal_lora_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/hduc-le/vit5-large-legal-lora + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-wl_ind_name_en.md b/docs/_posts/ahmedlone127/2024-08-22-wl_ind_name_en.md new file mode 100644 index 00000000000000..0163d30e47320f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-wl_ind_name_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English wl_ind_name T5Transformer from C-O-P-A +author: John Snow Labs +name: wl_ind_name +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wl_ind_name` is a English model originally trained by C-O-P-A. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wl_ind_name_en_5.4.2_3.0_1724363618526.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wl_ind_name_en_5.4.2_3.0_1724363618526.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("wl_ind_name","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("wl_ind_name", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wl_ind_name| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/C-O-P-A/WL-ind-name \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-wl_ind_name_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-wl_ind_name_pipeline_en.md new file mode 100644 index 00000000000000..bbb7b90ef61064 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-wl_ind_name_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English wl_ind_name_pipeline pipeline T5Transformer from C-O-P-A +author: John Snow Labs +name: wl_ind_name_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`wl_ind_name_pipeline` is a English model originally trained by C-O-P-A. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/wl_ind_name_pipeline_en_5.4.2_3.0_1724363753014.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/wl_ind_name_pipeline_en_5.4.2_3.0_1724363753014.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("wl_ind_name_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("wl_ind_name_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|wl_ind_name_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/C-O-P-A/WL-ind-name + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_cont1_en.md b/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_cont1_en.md new file mode 100644 index 00000000000000..e0cf438b56f6ab --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_cont1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_aligned_smallt5_cont1 T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_cont1 +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_cont1` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_cont1_en_5.4.2_3.0_1724298174278.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_cont1_en_5.4.2_3.0_1724298174278.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_aligned_smallt5_cont1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_aligned_smallt5_cont1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_cont1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5_cont1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_cont1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_cont1_pipeline_en.md new file mode 100644 index 00000000000000..9a4d7b262d6fdf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_cont1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_aligned_smallt5_cont1_pipeline pipeline T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_cont1_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_cont1_pipeline` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_cont1_pipeline_en_5.4.2_3.0_1724298190617.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_cont1_pipeline_en_5.4.2_3.0_1724298190617.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_aligned_smallt5_cont1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_aligned_smallt5_cont1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_cont1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5_cont1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_full_en.md b/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_full_en.md new file mode 100644 index 00000000000000..a1836e09b3fc65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_full_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_aligned_smallt5_full T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_full +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_full` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_full_en_5.4.2_3.0_1724315628510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_full_en_5.4.2_3.0_1724315628510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_aligned_smallt5_full","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_aligned_smallt5_full", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_full| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5_full \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_full_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_full_pipeline_en.md new file mode 100644 index 00000000000000..e129f0dd98c299 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-xsum_aligned_smallt5_full_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_aligned_smallt5_full_pipeline pipeline T5Transformer from paulh27 +author: John Snow Labs +name: xsum_aligned_smallt5_full_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_aligned_smallt5_full_pipeline` is a English model originally trained by paulh27. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_full_pipeline_en_5.4.2_3.0_1724315644806.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_aligned_smallt5_full_pipeline_en_5.4.2_3.0_1724315644806.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_aligned_smallt5_full_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_aligned_smallt5_full_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_aligned_smallt5_full_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|350.1 MB| + +## References + +https://huggingface.co/paulh27/xsum_aligned_smallT5_full + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-xsum_model_dthieu_en.md b/docs/_posts/ahmedlone127/2024-08-22-xsum_model_dthieu_en.md new file mode 100644 index 00000000000000..8e5a99cc9bd8c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-xsum_model_dthieu_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English xsum_model_dthieu T5Transformer from dthieu +author: John Snow Labs +name: xsum_model_dthieu +date: 2024-08-22 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_model_dthieu` is a English model originally trained by dthieu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_model_dthieu_en_5.4.2_3.0_1724301038768.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_model_dthieu_en_5.4.2_3.0_1724301038768.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("xsum_model_dthieu","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("xsum_model_dthieu", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_model_dthieu| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|343.6 MB| + +## References + +https://huggingface.co/dthieu/xsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-22-xsum_model_dthieu_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-22-xsum_model_dthieu_pipeline_en.md new file mode 100644 index 00000000000000..5f4c911e303a4c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-22-xsum_model_dthieu_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English xsum_model_dthieu_pipeline pipeline T5Transformer from dthieu +author: John Snow Labs +name: xsum_model_dthieu_pipeline +date: 2024-08-22 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`xsum_model_dthieu_pipeline` is a English model originally trained by dthieu. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/xsum_model_dthieu_pipeline_en_5.4.2_3.0_1724301057045.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/xsum_model_dthieu_pipeline_en_5.4.2_3.0_1724301057045.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("xsum_model_dthieu_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("xsum_model_dthieu_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|xsum_model_dthieu_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|343.6 MB| + +## References + +https://huggingface.co/dthieu/xsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt5_en.md b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt5_en.md new file mode 100644 index 00000000000000..1151f9f04781cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English assignment2_attempt5 T5Transformer from mpalaval +author: John Snow Labs +name: assignment2_attempt5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`assignment2_attempt5` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/assignment2_attempt5_en_5.4.2_3.0_1724398656837.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/assignment2_attempt5_en_5.4.2_3.0_1724398656837.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("assignment2_attempt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("assignment2_attempt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|assignment2_attempt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|783.7 MB| + +## References + +https://huggingface.co/mpalaval/assignment2_attempt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt5_pipeline_en.md new file mode 100644 index 00000000000000..b8e652765c369c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English assignment2_attempt5_pipeline pipeline T5Transformer from mpalaval +author: John Snow Labs +name: assignment2_attempt5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`assignment2_attempt5_pipeline` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/assignment2_attempt5_pipeline_en_5.4.2_3.0_1724398749310.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/assignment2_attempt5_pipeline_en_5.4.2_3.0_1724398749310.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("assignment2_attempt5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("assignment2_attempt5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|assignment2_attempt5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|783.7 MB| + +## References + +https://huggingface.co/mpalaval/assignment2_attempt5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt8_en.md b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt8_en.md new file mode 100644 index 00000000000000..46f81dfcc0c85a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English assignment2_attempt8 T5Transformer from mpalaval +author: John Snow Labs +name: assignment2_attempt8 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`assignment2_attempt8` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/assignment2_attempt8_en_5.4.2_3.0_1724389786905.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/assignment2_attempt8_en_5.4.2_3.0_1724389786905.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("assignment2_attempt8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("assignment2_attempt8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|assignment2_attempt8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|953.6 MB| + +## References + +https://huggingface.co/mpalaval/assignment2_attempt8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt8_pipeline_en.md new file mode 100644 index 00000000000000..1ebb45ede75a55 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-assignment2_attempt8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English assignment2_attempt8_pipeline pipeline T5Transformer from mpalaval +author: John Snow Labs +name: assignment2_attempt8_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`assignment2_attempt8_pipeline` is a English model originally trained by mpalaval. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/assignment2_attempt8_pipeline_en_5.4.2_3.0_1724389847948.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/assignment2_attempt8_pipeline_en_5.4.2_3.0_1724389847948.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("assignment2_attempt8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("assignment2_attempt8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|assignment2_attempt8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|953.6 MB| + +## References + +https://huggingface.co/mpalaval/assignment2_attempt8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_180000_en.md b/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_180000_en.md new file mode 100644 index 00000000000000..34576fef62a4da --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_180000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_para_v3_180000 T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_180000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_180000` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_180000_en_5.4.2_3.0_1724373991051.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_180000_en_5.4.2_3.0_1724373991051.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_para_v3_180000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_para_v3_180000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_180000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-180000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_180000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_180000_pipeline_en.md new file mode 100644 index 00000000000000..0bf6c7dd61d40c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_180000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_para_v3_180000_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_180000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_180000_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_180000_pipeline_en_5.4.2_3.0_1724374042878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_180000_pipeline_en_5.4.2_3.0_1724374042878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_para_v3_180000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_para_v3_180000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_180000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-180000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_60000_en.md b/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_60000_en.md new file mode 100644 index 00000000000000..9e246aa9f4c528 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_60000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bangla_para_v3_60000 T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_60000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_60000` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_60000_en_5.4.2_3.0_1724379146922.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_60000_en_5.4.2_3.0_1724379146922.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bangla_para_v3_60000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bangla_para_v3_60000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_60000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-60000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_60000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_60000_pipeline_en.md new file mode 100644 index 00000000000000..d9f3c32e87e50c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bangla_para_v3_60000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bangla_para_v3_60000_pipeline pipeline T5Transformer from mHossain +author: John Snow Labs +name: bangla_para_v3_60000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bangla_para_v3_60000_pipeline` is a English model originally trained by mHossain. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bangla_para_v3_60000_pipeline_en_5.4.2_3.0_1724379201236.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bangla_para_v3_60000_pipeline_en_5.4.2_3.0_1724379201236.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bangla_para_v3_60000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bangla_para_v3_60000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bangla_para_v3_60000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mHossain/bangla-para-v3-60000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bhc_flan_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-23-bhc_flan_t5_small_en.md new file mode 100644 index 00000000000000..08c55b469e9017 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bhc_flan_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English bhc_flan_t5_small T5Transformer from RyanZZZZZ +author: John Snow Labs +name: bhc_flan_t5_small +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bhc_flan_t5_small` is a English model originally trained by RyanZZZZZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bhc_flan_t5_small_en_5.4.2_3.0_1724392973824.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bhc_flan_t5_small_en_5.4.2_3.0_1724392973824.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bhc_flan_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bhc_flan_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bhc_flan_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/RyanZZZZZ/bhc_flan_t5_small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bhc_flan_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-bhc_flan_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..091b17ce580263 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bhc_flan_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English bhc_flan_t5_small_pipeline pipeline T5Transformer from RyanZZZZZ +author: John Snow Labs +name: bhc_flan_t5_small_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bhc_flan_t5_small_pipeline` is a English model originally trained by RyanZZZZZ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bhc_flan_t5_small_pipeline_en_5.4.2_3.0_1724392990422.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bhc_flan_t5_small_pipeline_en_5.4.2_3.0_1724392990422.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bhc_flan_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bhc_flan_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bhc_flan_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/RyanZZZZZ/bhc_flan_t5_small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-billsum_2118_t5_v1_1_base_en.md b/docs/_posts/ahmedlone127/2024-08-23-billsum_2118_t5_v1_1_base_en.md new file mode 100644 index 00000000000000..05f14ae0b541f2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-billsum_2118_t5_v1_1_base_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English billsum_2118_t5_v1_1_base T5Transformer from ryusangwon +author: John Snow Labs +name: billsum_2118_t5_v1_1_base +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`billsum_2118_t5_v1_1_base` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/billsum_2118_t5_v1_1_base_en_5.4.2_3.0_1724399026509.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/billsum_2118_t5_v1_1_base_en_5.4.2_3.0_1724399026509.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("billsum_2118_t5_v1_1_base","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("billsum_2118_t5_v1_1_base", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|billsum_2118_t5_v1_1_base| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|993.2 MB| + +## References + +https://huggingface.co/ryusangwon/billsum_2118_t5-v1_1-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-billsum_2118_t5_v1_1_base_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-billsum_2118_t5_v1_1_base_pipeline_en.md new file mode 100644 index 00000000000000..dd0eca1f73ec13 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-billsum_2118_t5_v1_1_base_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English billsum_2118_t5_v1_1_base_pipeline pipeline T5Transformer from ryusangwon +author: John Snow Labs +name: billsum_2118_t5_v1_1_base_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`billsum_2118_t5_v1_1_base_pipeline` is a English model originally trained by ryusangwon. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/billsum_2118_t5_v1_1_base_pipeline_en_5.4.2_3.0_1724399074955.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/billsum_2118_t5_v1_1_base_pipeline_en_5.4.2_3.0_1724399074955.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("billsum_2118_t5_v1_1_base_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("billsum_2118_t5_v1_1_base_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|billsum_2118_t5_v1_1_base_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|993.2 MB| + +## References + +https://huggingface.co/ryusangwon/billsum_2118_t5-v1_1-base + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-boolq_t5_small_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-boolq_t5_small_seed_2_en.md new file mode 100644 index 00000000000000..467906f674a615 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-boolq_t5_small_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English boolq_t5_small_seed_2 T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_small_seed_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_small_seed_2` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_small_seed_2_en_5.4.2_3.0_1724380971064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_small_seed_2_en_5.4.2_3.0_1724380971064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("boolq_t5_small_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("boolq_t5_small_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_small_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|323.3 MB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-small_seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-boolq_t5_small_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-boolq_t5_small_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..a5de4f435e2c5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-boolq_t5_small_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English boolq_t5_small_seed_2_pipeline pipeline T5Transformer from utahnlp +author: John Snow Labs +name: boolq_t5_small_seed_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`boolq_t5_small_seed_2_pipeline` is a English model originally trained by utahnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/boolq_t5_small_seed_2_pipeline_en_5.4.2_3.0_1724380992821.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/boolq_t5_small_seed_2_pipeline_en_5.4.2_3.0_1724380992821.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("boolq_t5_small_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("boolq_t5_small_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|boolq_t5_small_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|323.3 MB| + +## References + +https://huggingface.co/utahnlp/boolq_t5-small_seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bt5_base_thai_english_pipeline_th.md b/docs/_posts/ahmedlone127/2024-08-23-bt5_base_thai_english_pipeline_th.md new file mode 100644 index 00000000000000..ba9ac04dd9c6cd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bt5_base_thai_english_pipeline_th.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Thai bt5_base_thai_english_pipeline pipeline T5Transformer from BlackB +author: John Snow Labs +name: bt5_base_thai_english_pipeline +date: 2024-08-23 +tags: [th, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: th +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bt5_base_thai_english_pipeline` is a Thai model originally trained by BlackB. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bt5_base_thai_english_pipeline_th_5.4.2_3.0_1724392548049.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bt5_base_thai_english_pipeline_th_5.4.2_3.0_1724392548049.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("bt5_base_thai_english_pipeline", lang = "th") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("bt5_base_thai_english_pipeline", lang = "th") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bt5_base_thai_english_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|th| +|Size:|599.8 MB| + +## References + +https://huggingface.co/BlackB/bt5-base-thai-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-bt5_base_thai_english_th.md b/docs/_posts/ahmedlone127/2024-08-23-bt5_base_thai_english_th.md new file mode 100644 index 00000000000000..bed7ba8c6452c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-bt5_base_thai_english_th.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Thai bt5_base_thai_english T5Transformer from BlackB +author: John Snow Labs +name: bt5_base_thai_english +date: 2024-08-23 +tags: [th, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: th +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`bt5_base_thai_english` is a Thai model originally trained by BlackB. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/bt5_base_thai_english_th_5.4.2_3.0_1724392343913.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/bt5_base_thai_english_th_5.4.2_3.0_1724392343913.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("bt5_base_thai_english","th") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("bt5_base_thai_english", "th") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|bt5_base_thai_english| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|th| +|Size:|599.8 MB| + +## References + +https://huggingface.co/BlackB/bt5-base-thai-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_namnv78_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_namnv78_en.md new file mode 100644 index 00000000000000..d1fd17108d716e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_namnv78_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_namnv78 T5Transformer from Namnv78 +author: John Snow Labs +name: burmese_awesome_billsum_model_namnv78 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_namnv78` is a English model originally trained by Namnv78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_namnv78_en_5.4.2_3.0_1724378648733.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_namnv78_en_5.4.2_3.0_1724378648733.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_namnv78","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_namnv78", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_namnv78| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/Namnv78/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_namnv78_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_namnv78_pipeline_en.md new file mode 100644 index 00000000000000..22bdfc6ae86cf3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_namnv78_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_namnv78_pipeline pipeline T5Transformer from Namnv78 +author: John Snow Labs +name: burmese_awesome_billsum_model_namnv78_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_namnv78_pipeline` is a English model originally trained by Namnv78. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_namnv78_pipeline_en_5.4.2_3.0_1724378672784.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_namnv78_pipeline_en_5.4.2_3.0_1724378672784.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_namnv78_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_namnv78_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_namnv78_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|316.1 MB| + +## References + +https://huggingface.co/Namnv78/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_phongle1311_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_phongle1311_en.md new file mode 100644 index 00000000000000..5a3c443488ab02 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_phongle1311_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_phongle1311 T5Transformer from PhongLe1311 +author: John Snow Labs +name: burmese_awesome_billsum_model_phongle1311 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_phongle1311` is a English model originally trained by PhongLe1311. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_phongle1311_en_5.4.2_3.0_1724377815164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_phongle1311_en_5.4.2_3.0_1724377815164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_phongle1311","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_billsum_model_phongle1311", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_phongle1311| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.1 MB| + +## References + +https://huggingface.co/PhongLe1311/my_awesome_billsum_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_phongle1311_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_phongle1311_pipeline_en.md new file mode 100644 index 00000000000000..9f267292977c01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_billsum_model_phongle1311_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_billsum_model_phongle1311_pipeline pipeline T5Transformer from PhongLe1311 +author: John Snow Labs +name: burmese_awesome_billsum_model_phongle1311_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_billsum_model_phongle1311_pipeline` is a English model originally trained by PhongLe1311. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_phongle1311_pipeline_en_5.4.2_3.0_1724377836508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_billsum_model_phongle1311_pipeline_en_5.4.2_3.0_1724377836508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_billsum_model_phongle1311_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_billsum_model_phongle1311_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_billsum_model_phongle1311_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.1 MB| + +## References + +https://huggingface.co/PhongLe1311/my_awesome_billsum_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gaogao8_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gaogao8_en.md new file mode 100644 index 00000000000000..65c91e4d053bfa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gaogao8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_gaogao8 T5Transformer from gaogao8 +author: John Snow Labs +name: burmese_awesome_opus_books_model_gaogao8 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_gaogao8` is a English model originally trained by gaogao8. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_gaogao8_en_5.4.2_3.0_1724405805609.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_gaogao8_en_5.4.2_3.0_1724405805609.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_gaogao8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_gaogao8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_gaogao8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/gaogao8/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gaogao8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gaogao8_pipeline_en.md new file mode 100644 index 00000000000000..54df1e99c4ab7d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gaogao8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_gaogao8_pipeline pipeline T5Transformer from gaogao8 +author: John Snow Labs +name: burmese_awesome_opus_books_model_gaogao8_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_gaogao8_pipeline` is a English model originally trained by gaogao8. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_gaogao8_pipeline_en_5.4.2_3.0_1724405823138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_gaogao8_pipeline_en_5.4.2_3.0_1724405823138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_gaogao8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_gaogao8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_gaogao8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.4 MB| + +## References + +https://huggingface.co/gaogao8/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gunchar_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gunchar_en.md new file mode 100644 index 00000000000000..fdf47bc5f01bcd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gunchar_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_gunchar T5Transformer from Gunchar +author: John Snow Labs +name: burmese_awesome_opus_books_model_gunchar +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_gunchar` is a English model originally trained by Gunchar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_gunchar_en_5.4.2_3.0_1724397245398.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_gunchar_en_5.4.2_3.0_1724397245398.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_gunchar","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_gunchar", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_gunchar| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|262.9 MB| + +## References + +https://huggingface.co/Gunchar/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gunchar_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gunchar_pipeline_en.md new file mode 100644 index 00000000000000..ca79f1f9843cfd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_gunchar_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_gunchar_pipeline pipeline T5Transformer from Gunchar +author: John Snow Labs +name: burmese_awesome_opus_books_model_gunchar_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_gunchar_pipeline` is a English model originally trained by Gunchar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_gunchar_pipeline_en_5.4.2_3.0_1724397277703.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_gunchar_pipeline_en_5.4.2_3.0_1724397277703.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_gunchar_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_gunchar_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_gunchar_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|262.9 MB| + +## References + +https://huggingface.co/Gunchar/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_lkk688_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_lkk688_en.md new file mode 100644 index 00000000000000..f0f511b4b1b70c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_lkk688_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_lkk688 T5Transformer from lkk688 +author: John Snow Labs +name: burmese_awesome_opus_books_model_lkk688 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_lkk688` is a English model originally trained by lkk688. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_lkk688_en_5.4.2_3.0_1724386927562.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_lkk688_en_5.4.2_3.0_1724386927562.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_lkk688","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_lkk688", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_lkk688| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/lkk688/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_lkk688_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_lkk688_pipeline_en.md new file mode 100644 index 00000000000000..12d12fd595fb0f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_lkk688_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_lkk688_pipeline pipeline T5Transformer from lkk688 +author: John Snow Labs +name: burmese_awesome_opus_books_model_lkk688_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_lkk688_pipeline` is a English model originally trained by lkk688. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_lkk688_pipeline_en_5.4.2_3.0_1724386944525.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_lkk688_pipeline_en_5.4.2_3.0_1724386944525.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_lkk688_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_lkk688_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_lkk688_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.1 MB| + +## References + +https://huggingface.co/lkk688/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_pasto2003_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_pasto2003_en.md new file mode 100644 index 00000000000000..c8556ba3c871a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_pasto2003_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_pasto2003 T5Transformer from pasto2003 +author: John Snow Labs +name: burmese_awesome_opus_books_model_pasto2003 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_pasto2003` is a English model originally trained by pasto2003. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_pasto2003_en_5.4.2_3.0_1724373317201.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_pasto2003_en_5.4.2_3.0_1724373317201.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_pasto2003","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_pasto2003", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_pasto2003| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.7 MB| + +## References + +https://huggingface.co/pasto2003/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_pasto2003_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_pasto2003_pipeline_en.md new file mode 100644 index 00000000000000..b1ca846afca5fe --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_pasto2003_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_pasto2003_pipeline pipeline T5Transformer from pasto2003 +author: John Snow Labs +name: burmese_awesome_opus_books_model_pasto2003_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_pasto2003_pipeline` is a English model originally trained by pasto2003. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_pasto2003_pipeline_en_5.4.2_3.0_1724373336067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_pasto2003_pipeline_en_5.4.2_3.0_1724373336067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_pasto2003_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_pasto2003_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_pasto2003_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.7 MB| + +## References + +https://huggingface.co/pasto2003/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_tomodachisan_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_tomodachisan_en.md new file mode 100644 index 00000000000000..ba572f2fa19aee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_tomodachisan_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_tomodachisan T5Transformer from tomodachisan +author: John Snow Labs +name: burmese_awesome_opus_books_model_tomodachisan +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_tomodachisan` is a English model originally trained by tomodachisan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_tomodachisan_en_5.4.2_3.0_1724374386674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_tomodachisan_en_5.4.2_3.0_1724374386674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_tomodachisan","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_awesome_opus_books_model_tomodachisan", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_tomodachisan| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|289.9 MB| + +## References + +https://huggingface.co/tomodachisan/my_awesome_opus_books_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_tomodachisan_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_tomodachisan_pipeline_en.md new file mode 100644 index 00000000000000..b060ad76ab4b63 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_awesome_opus_books_model_tomodachisan_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_awesome_opus_books_model_tomodachisan_pipeline pipeline T5Transformer from tomodachisan +author: John Snow Labs +name: burmese_awesome_opus_books_model_tomodachisan_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_awesome_opus_books_model_tomodachisan_pipeline` is a English model originally trained by tomodachisan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_tomodachisan_pipeline_en_5.4.2_3.0_1724374414152.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_awesome_opus_books_model_tomodachisan_pipeline_en_5.4.2_3.0_1724374414152.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_awesome_opus_books_model_tomodachisan_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_awesome_opus_books_model_tomodachisan_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_awesome_opus_books_model_tomodachisan_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|289.9 MB| + +## References + +https://huggingface.co/tomodachisan/my_awesome_opus_books_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_language_model_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_language_model_en.md new file mode 100644 index 00000000000000..aa76d59e338b8e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_language_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English burmese_language_model T5Transformer from iraklisp +author: John Snow Labs +name: burmese_language_model +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_language_model` is a English model originally trained by iraklisp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_language_model_en_5.4.2_3.0_1724375896178.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_language_model_en_5.4.2_3.0_1724375896178.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("burmese_language_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("burmese_language_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_language_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|520.6 MB| + +## References + +https://huggingface.co/iraklisp/my_language_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-burmese_language_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-burmese_language_model_pipeline_en.md new file mode 100644 index 00000000000000..7b52acbbf43d09 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-burmese_language_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English burmese_language_model_pipeline pipeline T5Transformer from iraklisp +author: John Snow Labs +name: burmese_language_model_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`burmese_language_model_pipeline` is a English model originally trained by iraklisp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/burmese_language_model_pipeline_en_5.4.2_3.0_1724376073164.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/burmese_language_model_pipeline_en_5.4.2_3.0_1724376073164.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("burmese_language_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("burmese_language_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|burmese_language_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|520.6 MB| + +## References + +https://huggingface.co/iraklisp/my_language_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-checkpoint_6000_en.md b/docs/_posts/ahmedlone127/2024-08-23-checkpoint_6000_en.md new file mode 100644 index 00000000000000..8362b0a6565359 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-checkpoint_6000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English checkpoint_6000 T5Transformer from Danielber +author: John Snow Labs +name: checkpoint_6000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`checkpoint_6000` is a English model originally trained by Danielber. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/checkpoint_6000_en_5.4.2_3.0_1724404252358.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/checkpoint_6000_en_5.4.2_3.0_1724404252358.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("checkpoint_6000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("checkpoint_6000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|checkpoint_6000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|338.2 MB| + +## References + +https://huggingface.co/Danielber/checkpoint-6000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-checkpoint_6000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-checkpoint_6000_pipeline_en.md new file mode 100644 index 00000000000000..96dc8efc3cdaea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-checkpoint_6000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English checkpoint_6000_pipeline pipeline T5Transformer from Danielber +author: John Snow Labs +name: checkpoint_6000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`checkpoint_6000_pipeline` is a English model originally trained by Danielber. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/checkpoint_6000_pipeline_en_5.4.2_3.0_1724404271228.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/checkpoint_6000_pipeline_en_5.4.2_3.0_1724404271228.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("checkpoint_6000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("checkpoint_6000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|checkpoint_6000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|338.2 MB| + +## References + +https://huggingface.co/Danielber/checkpoint-6000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-clickbait_spoiling_phrase_en.md b/docs/_posts/ahmedlone127/2024-08-23-clickbait_spoiling_phrase_en.md new file mode 100644 index 00000000000000..e2a0f246515d41 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-clickbait_spoiling_phrase_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English clickbait_spoiling_phrase T5Transformer from Tugay +author: John Snow Labs +name: clickbait_spoiling_phrase +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`clickbait_spoiling_phrase` is a English model originally trained by Tugay. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/clickbait_spoiling_phrase_en_5.4.2_3.0_1724372885459.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/clickbait_spoiling_phrase_en_5.4.2_3.0_1724372885459.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("clickbait_spoiling_phrase","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("clickbait_spoiling_phrase", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|clickbait_spoiling_phrase| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Tugay/clickbait_spoiling_phrase \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-clickbait_spoiling_phrase_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-clickbait_spoiling_phrase_pipeline_en.md new file mode 100644 index 00000000000000..3506688f2cdc92 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-clickbait_spoiling_phrase_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English clickbait_spoiling_phrase_pipeline pipeline T5Transformer from Tugay +author: John Snow Labs +name: clickbait_spoiling_phrase_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`clickbait_spoiling_phrase_pipeline` is a English model originally trained by Tugay. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/clickbait_spoiling_phrase_pipeline_en_5.4.2_3.0_1724373022057.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/clickbait_spoiling_phrase_pipeline_en_5.4.2_3.0_1724373022057.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("clickbait_spoiling_phrase_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("clickbait_spoiling_phrase_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|clickbait_spoiling_phrase_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/Tugay/clickbait_spoiling_phrase + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-content_benagi2002_en.md b/docs/_posts/ahmedlone127/2024-08-23-content_benagi2002_en.md new file mode 100644 index 00000000000000..817191760dbce7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-content_benagi2002_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English content_benagi2002 T5Transformer from benagi2002 +author: John Snow Labs +name: content_benagi2002 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`content_benagi2002` is a English model originally trained by benagi2002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/content_benagi2002_en_5.4.2_3.0_1724399617991.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/content_benagi2002_en_5.4.2_3.0_1724399617991.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("content_benagi2002","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("content_benagi2002", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|content_benagi2002| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|335.6 MB| + +## References + +https://huggingface.co/benagi2002/content \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-content_benagi2002_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-content_benagi2002_pipeline_en.md new file mode 100644 index 00000000000000..4a9ef5e162f32c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-content_benagi2002_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English content_benagi2002_pipeline pipeline T5Transformer from benagi2002 +author: John Snow Labs +name: content_benagi2002_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`content_benagi2002_pipeline` is a English model originally trained by benagi2002. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/content_benagi2002_pipeline_en_5.4.2_3.0_1724399636855.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/content_benagi2002_pipeline_en_5.4.2_3.0_1724399636855.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("content_benagi2002_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("content_benagi2002_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|content_benagi2002_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|335.6 MB| + +## References + +https://huggingface.co/benagi2002/content + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-continue_corrupt_grammar_model_wmt446_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-continue_corrupt_grammar_model_wmt446_pipeline_en.md new file mode 100644 index 00000000000000..61bbdf34db1e06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-continue_corrupt_grammar_model_wmt446_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English continue_corrupt_grammar_model_wmt446_pipeline pipeline T5Transformer from mika5883 +author: John Snow Labs +name: continue_corrupt_grammar_model_wmt446_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`continue_corrupt_grammar_model_wmt446_pipeline` is a English model originally trained by mika5883. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/continue_corrupt_grammar_model_wmt446_pipeline_en_5.4.2_3.0_1724371202501.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/continue_corrupt_grammar_model_wmt446_pipeline_en_5.4.2_3.0_1724371202501.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("continue_corrupt_grammar_model_wmt446_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("continue_corrupt_grammar_model_wmt446_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|continue_corrupt_grammar_model_wmt446_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/mika5883/continue_corrupt_grammar_model_wmt446 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cptkginfusedlmsakharamaviationtriples20_en.md b/docs/_posts/ahmedlone127/2024-08-23-cptkginfusedlmsakharamaviationtriples20_en.md new file mode 100644 index 00000000000000..656fcf0a6018b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cptkginfusedlmsakharamaviationtriples20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cptkginfusedlmsakharamaviationtriples20 T5Transformer from sakharamg +author: John Snow Labs +name: cptkginfusedlmsakharamaviationtriples20 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptkginfusedlmsakharamaviationtriples20` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptkginfusedlmsakharamaviationtriples20_en_5.4.2_3.0_1724405397010.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptkginfusedlmsakharamaviationtriples20_en_5.4.2_3.0_1724405397010.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cptkginfusedlmsakharamaviationtriples20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cptkginfusedlmsakharamaviationtriples20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptkginfusedlmsakharamaviationtriples20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTKGinfusedLMsakharamaviationtriples20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cptkginfusedlmsakharamaviationtriples20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cptkginfusedlmsakharamaviationtriples20_pipeline_en.md new file mode 100644 index 00000000000000..a37afaf8700469 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cptkginfusedlmsakharamaviationtriples20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cptkginfusedlmsakharamaviationtriples20_pipeline pipeline T5Transformer from sakharamg +author: John Snow Labs +name: cptkginfusedlmsakharamaviationtriples20_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cptkginfusedlmsakharamaviationtriples20_pipeline` is a English model originally trained by sakharamg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cptkginfusedlmsakharamaviationtriples20_pipeline_en_5.4.2_3.0_1724405541966.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cptkginfusedlmsakharamaviationtriples20_pipeline_en_5.4.2_3.0_1724405541966.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cptkginfusedlmsakharamaviationtriples20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cptkginfusedlmsakharamaviationtriples20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cptkginfusedlmsakharamaviationtriples20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/sakharamg/CPTKGinfusedLMsakharamaviationtriples20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs341_camera_coqe_unicoqe_v2_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs341_camera_coqe_unicoqe_v2_en.md new file mode 100644 index 00000000000000..d5c6ab8da05315 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs341_camera_coqe_unicoqe_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs341_camera_coqe_unicoqe_v2 T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs341_camera_coqe_unicoqe_v2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs341_camera_coqe_unicoqe_v2` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_v2_en_5.4.2_3.0_1724389332534.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_v2_en_5.4.2_3.0_1724389332534.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs341_camera_coqe_unicoqe_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs341_camera_coqe_unicoqe_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs341_camera_coqe_unicoqe_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS341_Camera-COQE_UniCOQE_v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs341_camera_coqe_unicoqe_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs341_camera_coqe_unicoqe_v2_pipeline_en.md new file mode 100644 index 00000000000000..4a173c2ce07092 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs341_camera_coqe_unicoqe_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs341_camera_coqe_unicoqe_v2_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs341_camera_coqe_unicoqe_v2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs341_camera_coqe_unicoqe_v2_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_v2_pipeline_en_5.4.2_3.0_1724389386180.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs341_camera_coqe_unicoqe_v2_pipeline_en_5.4.2_3.0_1724389386180.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs341_camera_coqe_unicoqe_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs341_camera_coqe_unicoqe_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs341_camera_coqe_unicoqe_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS341_Camera-COQE_UniCOQE_v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_paosl_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_paosl_en.md new file mode 100644 index 00000000000000..a1ffa4905b867e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_paosl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_paosl T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_paosl +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_paosl` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_paosl_en_5.4.2_3.0_1724384261697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_paosl_en_5.4.2_3.0_1724384261697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_paosl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_paosl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_paosl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_PAOSL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_paosl_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_paosl_pipeline_en.md new file mode 100644 index 00000000000000..d7cc38ff62ce44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_paosl_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_paosl_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_paosl_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_paosl_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_paosl_pipeline_en_5.4.2_3.0_1724384428522.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_paosl_pipeline_en_5.4.2_3.0_1724384428522.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_paosl_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_paosl_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_paosl_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_PAOSL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_pasol_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_pasol_en.md new file mode 100644 index 00000000000000..1aefe13a9ed366 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_pasol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_pasol T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_pasol +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_pasol` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_pasol_en_5.4.2_3.0_1724376598921.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_pasol_en_5.4.2_3.0_1724376598921.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_pasol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_prompting5_pasol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_pasol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_PASOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_pasol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_pasol_pipeline_en.md new file mode 100644 index 00000000000000..7c2011f047df7c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_prompting5_pasol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_prompting5_pasol_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: cs505_coqe_vit5_prompting5_pasol_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_prompting5_pasol_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_pasol_pipeline_en_5.4.2_3.0_1724376773319.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_prompting5_pasol_pipeline_en_5.4.2_3.0_1724376773319.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_prompting5_pasol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_prompting5_pasol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_prompting5_pasol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/CS505_COQE_viT5_Prompting5_PASOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_posal_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_posal_v1_h1_en.md new file mode 100644 index 00000000000000..773972b50c2955 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_posal_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_posal_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_posal_v1_h1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_posal_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_posal_v1_h1_en_5.4.2_3.0_1724374283803.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_posal_v1_h1_en_5.4.2_3.0_1724374283803.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_posal_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_posal_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_posal_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_POSAL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..2bfcb242646044 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline_en_5.4.2_3.0_1724374457707.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline_en_5.4.2_3.0_1724374457707.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_posal_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_POSAL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_psaol_v1_h1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_psaol_v1_h1_en.md new file mode 100644 index 00000000000000..1c75272a3cc073 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_psaol_v1_h1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_psaol_v1_h1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_psaol_v1_h1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_psaol_v1_h1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_psaol_v1_h1_en_5.4.2_3.0_1724403985207.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_psaol_v1_h1_en_5.4.2_3.0_1724403985207.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_psaol_v1_h1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_psaol_v1_h1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_psaol_v1_h1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_PSAOL_v1_h1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline_en.md new file mode 100644 index 00000000000000..39195e7ebad51a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline_en_5.4.2_3.0_1724404165503.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline_en_5.4.2_3.0_1724404165503.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_PSAOL_v1_h1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_en.md new file mode 100644 index 00000000000000..06f848bfb04d89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instruction0_sopal_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instruction0_sopal_v1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instruction0_sopal_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_sopal_v1_en_5.4.2_3.0_1724386801168.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instruction0_sopal_v1_en_5.4.2_3.0_1724386801168.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_sopal_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instruction0_sopal_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instruction0_sopal_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_Instruction0_SOPAL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instructionn2_soapl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instructionn2_soapl_v1_en.md new file mode 100644 index 00000000000000..d07f271de13c7d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instructionn2_soapl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instructionn2_soapl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instructionn2_soapl_v1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instructionn2_soapl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn2_soapl_v1_en_5.4.2_3.0_1724397027515.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn2_soapl_v1_en_5.4.2_3.0_1724397027515.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instructionn2_soapl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_total_instructionn2_soapl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instructionn2_soapl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_InstructionN2_SOAPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline_en.md new file mode 100644 index 00000000000000..11d5a99d456718 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline_en_5.4.2_3.0_1724397198495.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline_en_5.4.2_3.0_1724397198495.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_total_InstructionN2_SOAPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_aspol_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_aspol_en.md new file mode 100644 index 00000000000000..308126dabf4113 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_aspol_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aspol T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aspol +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aspol` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_en_5.4.2_3.0_1724396689252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_en_5.4.2_3.0_1724396689252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aspol","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_aspol", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aspol| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_ASPOL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_aspol_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_aspol_pipeline_en.md new file mode 100644 index 00000000000000..76855c90433032 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_aspol_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_aspol_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_aspol_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_aspol_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_pipeline_en_5.4.2_3.0_1724396909808.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_aspol_pipeline_en_5.4.2_3.0_1724396909808.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aspol_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_aspol_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_aspol_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_ASPOL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_opsal_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_opsal_en.md new file mode 100644 index 00000000000000..f8434c57d2ba70 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_opsal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_opsal T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_opsal +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_opsal` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_opsal_en_5.4.2_3.0_1724390967633.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_opsal_en_5.4.2_3.0_1724390967633.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_opsal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_opsal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_opsal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OPSAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_opsal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_opsal_pipeline_en.md new file mode 100644 index 00000000000000..bf0f42be5e492a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_opsal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_opsal_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_opsal_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_opsal_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_opsal_pipeline_en_5.4.2_3.0_1724391137049.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_opsal_pipeline_en_5.4.2_3.0_1724391137049.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_opsal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_opsal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_opsal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OPSAL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_ospal_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_ospal_en.md new file mode 100644 index 00000000000000..c0837f77967116 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_ospal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_ospal T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_ospal +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_ospal` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_en_5.4.2_3.0_1724380534582.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_en_5.4.2_3.0_1724380534582.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_ospal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instruction0_ospal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_ospal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OSPAL \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_ospal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_ospal_pipeline_en.md new file mode 100644 index 00000000000000..5b7685f9b41829 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instruction0_ospal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instruction0_ospal_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instruction0_ospal_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instruction0_ospal_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_pipeline_en_5.4.2_3.0_1724380696785.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instruction0_ospal_pipeline_en_5.4.2_3.0_1724380696785.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instruction0_ospal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instruction0_ospal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instruction0_ospal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_Instruction0_OSPAL + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn4_oaspl_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn4_oaspl_v1_en.md new file mode 100644 index 00000000000000..30c808d246865f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn4_oaspl_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn4_oaspl_v1 T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn4_oaspl_v1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn4_oaspl_v1` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_oaspl_v1_en_5.4.2_3.0_1724394667742.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_oaspl_v1_en_5.4.2_3.0_1724394667742.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn4_oaspl_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("cs505_coqe_vit5_train_instructionn4_oaspl_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn4_oaspl_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN4_OASPL_v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline_en.md new file mode 100644 index 00000000000000..0125a9b0cecea6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline pipeline T5Transformer from ThuyNT +author: John Snow Labs +name: cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline` is a English model originally trained by ThuyNT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline_en_5.4.2_3.0_1724394845434.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline_en_5.4.2_3.0_1724394845434.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT/CS505_COQE_viT5_train_InstructionN4_OASPL_v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ds_chatbot_vit5_large_finetune_en.md b/docs/_posts/ahmedlone127/2024-08-23-ds_chatbot_vit5_large_finetune_en.md new file mode 100644 index 00000000000000..e5cc449b494fac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ds_chatbot_vit5_large_finetune_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ds_chatbot_vit5_large_finetune T5Transformer from suzii +author: John Snow Labs +name: ds_chatbot_vit5_large_finetune +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ds_chatbot_vit5_large_finetune` is a English model originally trained by suzii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_large_finetune_en_5.4.2_3.0_1724383281584.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_large_finetune_en_5.4.2_3.0_1724383281584.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ds_chatbot_vit5_large_finetune","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ds_chatbot_vit5_large_finetune", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ds_chatbot_vit5_large_finetune| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/suzii/DS-Chatbot-vit5-large_finetune \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ds_chatbot_vit5_large_finetune_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-ds_chatbot_vit5_large_finetune_pipeline_en.md new file mode 100644 index 00000000000000..9dd2ad8400c146 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ds_chatbot_vit5_large_finetune_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ds_chatbot_vit5_large_finetune_pipeline pipeline T5Transformer from suzii +author: John Snow Labs +name: ds_chatbot_vit5_large_finetune_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ds_chatbot_vit5_large_finetune_pipeline` is a English model originally trained by suzii. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_large_finetune_pipeline_en_5.4.2_3.0_1724383446655.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ds_chatbot_vit5_large_finetune_pipeline_en_5.4.2_3.0_1724383446655.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ds_chatbot_vit5_large_finetune_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ds_chatbot_vit5_large_finetune_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ds_chatbot_vit5_large_finetune_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/suzii/DS-Chatbot-vit5-large_finetune + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-dst_model_en.md b/docs/_posts/ahmedlone127/2024-08-23-dst_model_en.md new file mode 100644 index 00000000000000..45aa2da4e1c45b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-dst_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English dst_model T5Transformer from songbo +author: John Snow Labs +name: dst_model +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dst_model` is a English model originally trained by songbo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dst_model_en_5.4.2_3.0_1724397094197.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dst_model_en_5.4.2_3.0_1724397094197.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("dst_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("dst_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dst_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.3 MB| + +## References + +https://huggingface.co/songbo/dst_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-dst_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-dst_model_pipeline_en.md new file mode 100644 index 00000000000000..2c70c5ec0b4c0b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-dst_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English dst_model_pipeline pipeline T5Transformer from songbo +author: John Snow Labs +name: dst_model_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`dst_model_pipeline` is a English model originally trained by songbo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/dst_model_pipeline_en_5.4.2_3.0_1724397111690.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/dst_model_pipeline_en_5.4.2_3.0_1724397111690.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("dst_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("dst_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|dst_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.3 MB| + +## References + +https://huggingface.co/songbo/dst_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-email_summarization_model_t5_en.md b/docs/_posts/ahmedlone127/2024-08-23-email_summarization_model_t5_en.md new file mode 100644 index 00000000000000..4c3ce6c790f736 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-email_summarization_model_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English email_summarization_model_t5 T5Transformer from egorishti +author: John Snow Labs +name: email_summarization_model_t5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`email_summarization_model_t5` is a English model originally trained by egorishti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/email_summarization_model_t5_en_5.4.2_3.0_1724389636230.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/email_summarization_model_t5_en_5.4.2_3.0_1724389636230.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("email_summarization_model_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("email_summarization_model_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|email_summarization_model_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|307.3 MB| + +## References + +https://huggingface.co/egorishti/email-summarization-model-t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-email_summarization_model_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-email_summarization_model_t5_pipeline_en.md new file mode 100644 index 00000000000000..188a0adb82ced5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-email_summarization_model_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English email_summarization_model_t5_pipeline pipeline T5Transformer from egorishti +author: John Snow Labs +name: email_summarization_model_t5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`email_summarization_model_t5_pipeline` is a English model originally trained by egorishti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/email_summarization_model_t5_pipeline_en_5.4.2_3.0_1724389656946.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/email_summarization_model_t5_pipeline_en_5.4.2_3.0_1724389656946.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("email_summarization_model_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("email_summarization_model_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|email_summarization_model_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|307.3 MB| + +## References + +https://huggingface.co/egorishti/email-summarization-model-t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ensemble_icl_t0_large_en.md b/docs/_posts/ahmedlone127/2024-08-23-ensemble_icl_t0_large_en.md new file mode 100644 index 00000000000000..dd067b214599a9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ensemble_icl_t0_large_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ensemble_icl_t0_large T5Transformer from qinyuany +author: John Snow Labs +name: ensemble_icl_t0_large +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ensemble_icl_t0_large` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ensemble_icl_t0_large_en_5.4.2_3.0_1724392513147.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ensemble_icl_t0_large_en_5.4.2_3.0_1724392513147.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ensemble_icl_t0_large","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ensemble_icl_t0_large", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ensemble_icl_t0_large| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/qinyuany/ensemble-icl-t0-large \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ensemble_icl_t0_large_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-ensemble_icl_t0_large_pipeline_en.md new file mode 100644 index 00000000000000..5b20e05ca0efbc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ensemble_icl_t0_large_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ensemble_icl_t0_large_pipeline pipeline T5Transformer from qinyuany +author: John Snow Labs +name: ensemble_icl_t0_large_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ensemble_icl_t0_large_pipeline` is a English model originally trained by qinyuany. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ensemble_icl_t0_large_pipeline_en_5.4.2_3.0_1724392650383.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ensemble_icl_t0_large_pipeline_en_5.4.2_3.0_1724392650383.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ensemble_icl_t0_large_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ensemble_icl_t0_large_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ensemble_icl_t0_large_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/qinyuany/ensemble-icl-t0-large + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-error_test_en.md b/docs/_posts/ahmedlone127/2024-08-23-error_test_en.md new file mode 100644 index 00000000000000..0cf3f1fe95b7d3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-error_test_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English error_test T5Transformer from ahsan-mavros +author: John Snow Labs +name: error_test +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`error_test` is a English model originally trained by ahsan-mavros. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/error_test_en_5.4.2_3.0_1724372704971.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/error_test_en_5.4.2_3.0_1724372704971.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("error_test","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("error_test", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|error_test| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ahsan-mavros/error-test \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-error_test_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-error_test_pipeline_en.md new file mode 100644 index 00000000000000..b37ac0c4fce04c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-error_test_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English error_test_pipeline pipeline T5Transformer from ahsan-mavros +author: John Snow Labs +name: error_test_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`error_test_pipeline` is a English model originally trained by ahsan-mavros. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/error_test_pipeline_en_5.4.2_3.0_1724372751077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/error_test_pipeline_en_5.4.2_3.0_1724372751077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("error_test_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("error_test_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|error_test_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ahsan-mavros/error-test + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-finetune_t5_base_only_hack_en.md b/docs/_posts/ahmedlone127/2024-08-23-finetune_t5_base_only_hack_en.md new file mode 100644 index 00000000000000..e13db0955d801f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-finetune_t5_base_only_hack_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_t5_base_only_hack T5Transformer from rhythm00 +author: John Snow Labs +name: finetune_t5_base_only_hack +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_t5_base_only_hack` is a English model originally trained by rhythm00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_t5_base_only_hack_en_5.4.2_3.0_1724372480830.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_t5_base_only_hack_en_5.4.2_3.0_1724372480830.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_t5_base_only_hack","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_t5_base_only_hack", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_t5_base_only_hack| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|998.6 MB| + +## References + +https://huggingface.co/rhythm00/finetune_t5_base_only_hack \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-finetune_t5_base_only_hack_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-finetune_t5_base_only_hack_pipeline_en.md new file mode 100644 index 00000000000000..93e38b15ad2af0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-finetune_t5_base_only_hack_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_t5_base_only_hack_pipeline pipeline T5Transformer from rhythm00 +author: John Snow Labs +name: finetune_t5_base_only_hack_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_t5_base_only_hack_pipeline` is a English model originally trained by rhythm00. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_t5_base_only_hack_pipeline_en_5.4.2_3.0_1724372527988.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_t5_base_only_hack_pipeline_en_5.4.2_3.0_1724372527988.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_t5_base_only_hack_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_t5_base_only_hack_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_t5_base_only_hack_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|998.6 MB| + +## References + +https://huggingface.co/rhythm00/finetune_t5_base_only_hack + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-finetune_true_case_t5_tiny_standard_bahasa_cased_en.md b/docs/_posts/ahmedlone127/2024-08-23-finetune_true_case_t5_tiny_standard_bahasa_cased_en.md new file mode 100644 index 00000000000000..cd618236b22eb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-finetune_true_case_t5_tiny_standard_bahasa_cased_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetune_true_case_t5_tiny_standard_bahasa_cased T5Transformer from mesolitica +author: John Snow Labs +name: finetune_true_case_t5_tiny_standard_bahasa_cased +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_true_case_t5_tiny_standard_bahasa_cased` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_true_case_t5_tiny_standard_bahasa_cased_en_5.4.2_3.0_1724373656981.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_true_case_t5_tiny_standard_bahasa_cased_en_5.4.2_3.0_1724373656981.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetune_true_case_t5_tiny_standard_bahasa_cased","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetune_true_case_t5_tiny_standard_bahasa_cased", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_true_case_t5_tiny_standard_bahasa_cased| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|222.9 MB| + +## References + +https://huggingface.co/mesolitica/finetune-true-case-t5-tiny-standard-bahasa-cased \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline_en.md new file mode 100644 index 00000000000000..44fbe0857043f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline pipeline T5Transformer from mesolitica +author: John Snow Labs +name: finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline` is a English model originally trained by mesolitica. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724373669437.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline_en_5.4.2_3.0_1724373669437.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetune_true_case_t5_tiny_standard_bahasa_cased_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|222.9 MB| + +## References + +https://huggingface.co/mesolitica/finetune-true-case-t5-tiny-standard-bahasa-cased + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-finetuned_newwikilingua_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-23-finetuned_newwikilingua_summarization_en.md new file mode 100644 index 00000000000000..d5ff3e018c1539 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-finetuned_newwikilingua_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_newwikilingua_summarization T5Transformer from minnehwg +author: John Snow Labs +name: finetuned_newwikilingua_summarization +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_newwikilingua_summarization` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_newwikilingua_summarization_en_5.4.2_3.0_1724400396514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_newwikilingua_summarization_en_5.4.2_3.0_1724400396514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_newwikilingua_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_newwikilingua_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_newwikilingua_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/finetuned-newwikilingua-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-finetuned_newwikilingua_summarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-finetuned_newwikilingua_summarization_pipeline_en.md new file mode 100644 index 00000000000000..6b83e274b3e99d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-finetuned_newwikilingua_summarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_newwikilingua_summarization_pipeline pipeline T5Transformer from minnehwg +author: John Snow Labs +name: finetuned_newwikilingua_summarization_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_newwikilingua_summarization_pipeline` is a English model originally trained by minnehwg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_newwikilingua_summarization_pipeline_en_5.4.2_3.0_1724400446697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_newwikilingua_summarization_pipeline_en_5.4.2_3.0_1724400446697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_newwikilingua_summarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_newwikilingua_summarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_newwikilingua_summarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/minnehwg/finetuned-newwikilingua-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-finetuned_t5_cnn_dailymail_pippinnie_en.md b/docs/_posts/ahmedlone127/2024-08-23-finetuned_t5_cnn_dailymail_pippinnie_en.md new file mode 100644 index 00000000000000..256072644ef47c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-finetuned_t5_cnn_dailymail_pippinnie_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English finetuned_t5_cnn_dailymail_pippinnie T5Transformer from pippinnie +author: John Snow Labs +name: finetuned_t5_cnn_dailymail_pippinnie +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_cnn_dailymail_pippinnie` is a English model originally trained by pippinnie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_cnn_dailymail_pippinnie_en_5.4.2_3.0_1724371312923.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_cnn_dailymail_pippinnie_en_5.4.2_3.0_1724371312923.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("finetuned_t5_cnn_dailymail_pippinnie","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("finetuned_t5_cnn_dailymail_pippinnie", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_cnn_dailymail_pippinnie| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|301.8 MB| + +## References + +https://huggingface.co/pippinnie/finetuned-t5-cnn_dailymail \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-finetuned_t5_cnn_dailymail_pippinnie_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-finetuned_t5_cnn_dailymail_pippinnie_pipeline_en.md new file mode 100644 index 00000000000000..52eb2c4ac8834b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-finetuned_t5_cnn_dailymail_pippinnie_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English finetuned_t5_cnn_dailymail_pippinnie_pipeline pipeline T5Transformer from pippinnie +author: John Snow Labs +name: finetuned_t5_cnn_dailymail_pippinnie_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`finetuned_t5_cnn_dailymail_pippinnie_pipeline` is a English model originally trained by pippinnie. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/finetuned_t5_cnn_dailymail_pippinnie_pipeline_en_5.4.2_3.0_1724371340330.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/finetuned_t5_cnn_dailymail_pippinnie_pipeline_en_5.4.2_3.0_1724371340330.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("finetuned_t5_cnn_dailymail_pippinnie_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("finetuned_t5_cnn_dailymail_pippinnie_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|finetuned_t5_cnn_dailymail_pippinnie_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|301.8 MB| + +## References + +https://huggingface.co/pippinnie/finetuned-t5-cnn_dailymail + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_fold_3_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_fold_3_en.md new file mode 100644 index 00000000000000..5d58ff1f5bdcb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_fold_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_fold_3 T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_base_fold_3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_fold_3` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_fold_3_en_5.4.2_3.0_1724398640348.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_fold_3_en_5.4.2_3.0_1724398640348.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_fold_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_fold_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_fold_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-dump/flan-t5-base_fold_3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_fold_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_fold_3_pipeline_en.md new file mode 100644 index 00000000000000..110a5907d9a39b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_fold_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_fold_3_pipeline pipeline T5Transformer from research-dump +author: John Snow Labs +name: flan_t5_base_fold_3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_fold_3_pipeline` is a English model originally trained by research-dump. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_fold_3_pipeline_en_5.4.2_3.0_1724398687879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_fold_3_pipeline_en_5.4.2_3.0_1724398687879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_fold_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_fold_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_fold_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/research-dump/flan-t5-base_fold_3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_imdb_text_classification_sherif1311_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_imdb_text_classification_sherif1311_en.md new file mode 100644 index 00000000000000..dc8736d1c8a7fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_imdb_text_classification_sherif1311_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_sherif1311 T5Transformer from sherif1311 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_sherif1311 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_sherif1311` is a English model originally trained by sherif1311. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_sherif1311_en_5.4.2_3.0_1724377803814.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_sherif1311_en_5.4.2_3.0_1724377803814.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_sherif1311","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_imdb_text_classification_sherif1311", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_sherif1311| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sherif1311/flan-t5-base-imdb-text-classification \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_imdb_text_classification_sherif1311_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_imdb_text_classification_sherif1311_pipeline_en.md new file mode 100644 index 00000000000000..bdf17be1747634 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_imdb_text_classification_sherif1311_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_imdb_text_classification_sherif1311_pipeline pipeline T5Transformer from sherif1311 +author: John Snow Labs +name: flan_t5_base_imdb_text_classification_sherif1311_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_imdb_text_classification_sherif1311_pipeline` is a English model originally trained by sherif1311. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_sherif1311_pipeline_en_5.4.2_3.0_1724377855360.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_imdb_text_classification_sherif1311_pipeline_en_5.4.2_3.0_1724377855360.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_imdb_text_classification_sherif1311_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_imdb_text_classification_sherif1311_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_imdb_text_classification_sherif1311_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/sherif1311/flan-t5-base-imdb-text-classification + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_qg_squad_10_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_qg_squad_10_en.md new file mode 100644 index 00000000000000..8ee18349f38feb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_qg_squad_10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_qg_squad_10 T5Transformer from tarek23 +author: John Snow Labs +name: flan_t5_base_qg_squad_10 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_qg_squad_10` is a English model originally trained by tarek23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_qg_squad_10_en_5.4.2_3.0_1724403885744.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_qg_squad_10_en_5.4.2_3.0_1724403885744.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_qg_squad_10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_qg_squad_10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_qg_squad_10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tarek23/flan-t5-base-qg-SQuAD-10 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_qg_squad_10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_qg_squad_10_pipeline_en.md new file mode 100644 index 00000000000000..b69bcdac5e3a0a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_qg_squad_10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_qg_squad_10_pipeline pipeline T5Transformer from tarek23 +author: John Snow Labs +name: flan_t5_base_qg_squad_10_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_qg_squad_10_pipeline` is a English model originally trained by tarek23. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_qg_squad_10_pipeline_en_5.4.2_3.0_1724403932922.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_qg_squad_10_pipeline_en_5.4.2_3.0_1724403932922.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_qg_squad_10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_qg_squad_10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_qg_squad_10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/tarek23/flan-t5-base-qg-SQuAD-10 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_tempo_wic_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_tempo_wic_en.md new file mode 100644 index 00000000000000..3e0a6d351b4d12 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_tempo_wic_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_tempo_wic T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tempo_wic +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tempo_wic` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tempo_wic_en_5.4.2_3.0_1724398924335.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tempo_wic_en_5.4.2_3.0_1724398924335.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_tempo_wic","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_tempo_wic", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tempo_wic| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tempo-wic \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_tempo_wic_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_tempo_wic_pipeline_en.md new file mode 100644 index 00000000000000..83fa4fd71a4ad1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_tempo_wic_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_tempo_wic_pipeline pipeline T5Transformer from cardiffnlp +author: John Snow Labs +name: flan_t5_base_tempo_wic_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_tempo_wic_pipeline` is a English model originally trained by cardiffnlp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_tempo_wic_pipeline_en_5.4.2_3.0_1724398975656.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_tempo_wic_pipeline_en_5.4.2_3.0_1724398975656.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_tempo_wic_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_tempo_wic_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_tempo_wic_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/cardiffnlp/flan-t5-base-tempo-wic + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_text_summarization_data_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_text_summarization_data_en.md new file mode 100644 index 00000000000000..d0da1ebcc65b7b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_text_summarization_data_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_text_summarization_data T5Transformer from Dhirajkumar +author: John Snow Labs +name: flan_t5_base_text_summarization_data +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_text_summarization_data` is a English model originally trained by Dhirajkumar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_text_summarization_data_en_5.4.2_3.0_1724393371264.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_text_summarization_data_en_5.4.2_3.0_1724393371264.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_text_summarization_data","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_text_summarization_data", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_text_summarization_data| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Dhirajkumar/flan-t5-base-text_summarization_data \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_text_summarization_data_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_text_summarization_data_pipeline_en.md new file mode 100644 index 00000000000000..64d1ec084a7c7f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_text_summarization_data_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_text_summarization_data_pipeline pipeline T5Transformer from Dhirajkumar +author: John Snow Labs +name: flan_t5_base_text_summarization_data_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_text_summarization_data_pipeline` is a English model originally trained by Dhirajkumar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_text_summarization_data_pipeline_en_5.4.2_3.0_1724393419756.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_text_summarization_data_pipeline_en_5.4.2_3.0_1724393419756.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_text_summarization_data_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_text_summarization_data_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_text_summarization_data_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Dhirajkumar/flan-t5-base-text_summarization_data + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_yake_top3_asks_qg_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_yake_top3_asks_qg_en.md new file mode 100644 index 00000000000000..71d3e29dd8ca14 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_yake_top3_asks_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_base_yake_top3_asks_qg T5Transformer from dhmeltzer +author: John Snow Labs +name: flan_t5_base_yake_top3_asks_qg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_yake_top3_asks_qg` is a English model originally trained by dhmeltzer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_yake_top3_asks_qg_en_5.4.2_3.0_1724388259721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_yake_top3_asks_qg_en_5.4.2_3.0_1724388259721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_base_yake_top3_asks_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_base_yake_top3_asks_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_yake_top3_asks_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dhmeltzer/flan-t5-base_yake_top3_asks_qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_yake_top3_asks_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_yake_top3_asks_qg_pipeline_en.md new file mode 100644 index 00000000000000..0ca0e651eb006c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_base_yake_top3_asks_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_base_yake_top3_asks_qg_pipeline pipeline T5Transformer from dhmeltzer +author: John Snow Labs +name: flan_t5_base_yake_top3_asks_qg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_base_yake_top3_asks_qg_pipeline` is a English model originally trained by dhmeltzer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_base_yake_top3_asks_qg_pipeline_en_5.4.2_3.0_1724388307229.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_base_yake_top3_asks_qg_pipeline_en_5.4.2_3.0_1724388307229.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_base_yake_top3_asks_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_base_yake_top3_asks_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_base_yake_top3_asks_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/dhmeltzer/flan-t5-base_yake_top3_asks_qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_kelm_tekgen_kongo_direct_small_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_kelm_tekgen_kongo_direct_small_en.md new file mode 100644 index 00000000000000..893220a5aed93c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_kelm_tekgen_kongo_direct_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_kelm_tekgen_kongo_direct_small T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_kelm_tekgen_kongo_direct_small +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_kelm_tekgen_kongo_direct_small` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_small_en_5.4.2_3.0_1724397581689.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_small_en_5.4.2_3.0_1724397581689.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_kelm_tekgen_kongo_direct_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_kelm_tekgen_kongo_direct_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_kelm_tekgen_kongo_direct_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|348.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-kelm-tekgen-kg-direct-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_kelm_tekgen_kongo_direct_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_kelm_tekgen_kongo_direct_small_pipeline_en.md new file mode 100644 index 00000000000000..e52bc65cb03ac1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_kelm_tekgen_kongo_direct_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_kelm_tekgen_kongo_direct_small_pipeline pipeline T5Transformer from kinshuk-h +author: John Snow Labs +name: flan_t5_kelm_tekgen_kongo_direct_small_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_kelm_tekgen_kongo_direct_small_pipeline` is a English model originally trained by kinshuk-h. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_small_pipeline_en_5.4.2_3.0_1724397600363.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_kelm_tekgen_kongo_direct_small_pipeline_en_5.4.2_3.0_1724397600363.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_kelm_tekgen_kongo_direct_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_kelm_tekgen_kongo_direct_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_kelm_tekgen_kongo_direct_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|348.6 MB| + +## References + +https://huggingface.co/kinshuk-h/flan-t5-kelm-tekgen-kg-direct-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_medistill_46_ep20_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_medistill_46_ep20_en.md new file mode 100644 index 00000000000000..e1c4312b8845b4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_medistill_46_ep20_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_large_medistill_46_ep20 T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_46_ep20 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_46_ep20` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_46_ep20_en_5.4.2_3.0_1724372484924.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_46_ep20_en_5.4.2_3.0_1724372484924.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_large_medistill_46_ep20","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_large_medistill_46_ep20", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_46_ep20| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_46_ep20 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_medistill_46_ep20_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_medistill_46_ep20_pipeline_en.md new file mode 100644 index 00000000000000..ce4eb2dd86590b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_large_medistill_46_ep20_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_large_medistill_46_ep20_pipeline pipeline T5Transformer from Xiaolihai +author: John Snow Labs +name: flan_t5_large_medistill_46_ep20_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_large_medistill_46_ep20_pipeline` is a English model originally trained by Xiaolihai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_46_ep20_pipeline_en_5.4.2_3.0_1724372628114.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_large_medistill_46_ep20_pipeline_en_5.4.2_3.0_1724372628114.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_large_medistill_46_ep20_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_large_medistill_46_ep20_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_large_medistill_46_ep20_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Xiaolihai/flan-t5-large_MeDistill_46_ep20 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetune_medicine_v3_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetune_medicine_v3_en.md new file mode 100644 index 00000000000000..6c498eead83adb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetune_medicine_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_finetune_medicine_v3 T5Transformer from Varshitha +author: John Snow Labs +name: flan_t5_small_finetune_medicine_v3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetune_medicine_v3` is a English model originally trained by Varshitha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetune_medicine_v3_en_5.4.2_3.0_1724376137669.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetune_medicine_v3_en_5.4.2_3.0_1724376137669.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_finetune_medicine_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_finetune_medicine_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetune_medicine_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Varshitha/flan-t5-small-finetune-medicine-v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetune_medicine_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetune_medicine_v3_pipeline_en.md new file mode 100644 index 00000000000000..bb8ba2abb0f954 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetune_medicine_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_finetune_medicine_v3_pipeline pipeline T5Transformer from Varshitha +author: John Snow Labs +name: flan_t5_small_finetune_medicine_v3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetune_medicine_v3_pipeline` is a English model originally trained by Varshitha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetune_medicine_v3_pipeline_en_5.4.2_3.0_1724376154884.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetune_medicine_v3_pipeline_en_5.4.2_3.0_1724376154884.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_finetune_medicine_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_finetune_medicine_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetune_medicine_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Varshitha/flan-t5-small-finetune-medicine-v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_americo_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_americo_en.md new file mode 100644 index 00000000000000..a87ebaf4b90803 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_americo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_finetuned_xsum_americo T5Transformer from Americo +author: John Snow Labs +name: flan_t5_small_finetuned_xsum_americo +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_xsum_americo` is a English model originally trained by Americo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_americo_en_5.4.2_3.0_1724392708416.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_americo_en_5.4.2_3.0_1724392708416.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_finetuned_xsum_americo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_finetuned_xsum_americo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_xsum_americo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Americo/flan-t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_americo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_americo_pipeline_en.md new file mode 100644 index 00000000000000..e22ebf1d2d2b9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_americo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_finetuned_xsum_americo_pipeline pipeline T5Transformer from Americo +author: John Snow Labs +name: flan_t5_small_finetuned_xsum_americo_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_xsum_americo_pipeline` is a English model originally trained by Americo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_americo_pipeline_en_5.4.2_3.0_1724392725355.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_americo_pipeline_en_5.4.2_3.0_1724392725355.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_finetuned_xsum_americo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_finetuned_xsum_americo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_xsum_americo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/Americo/flan-t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_phobost_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_phobost_en.md new file mode 100644 index 00000000000000..ac07a482d9adc5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_phobost_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_finetuned_xsum_phobost T5Transformer from PhobosT +author: John Snow Labs +name: flan_t5_small_finetuned_xsum_phobost +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_xsum_phobost` is a English model originally trained by PhobosT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_phobost_en_5.4.2_3.0_1724393234238.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_phobost_en_5.4.2_3.0_1724393234238.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_finetuned_xsum_phobost","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_finetuned_xsum_phobost", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_xsum_phobost| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/PhobosT/flan-t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_phobost_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_phobost_pipeline_en.md new file mode 100644 index 00000000000000..e3c370dee4916a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_finetuned_xsum_phobost_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_finetuned_xsum_phobost_pipeline pipeline T5Transformer from PhobosT +author: John Snow Labs +name: flan_t5_small_finetuned_xsum_phobost_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_finetuned_xsum_phobost_pipeline` is a English model originally trained by PhobosT. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_phobost_pipeline_en_5.4.2_3.0_1724393250192.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_finetuned_xsum_phobost_pipeline_en_5.4.2_3.0_1724393250192.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_finetuned_xsum_phobost_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_finetuned_xsum_phobost_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_finetuned_xsum_phobost_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/PhobosT/flan-t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_prassu10_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_prassu10_en.md new file mode 100644 index 00000000000000..6ba4e879696b3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_prassu10_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_prassu10 T5Transformer from prassu10 +author: John Snow Labs +name: flan_t5_small_prassu10 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_prassu10` is a English model originally trained by prassu10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_prassu10_en_5.4.2_3.0_1724388306627.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_prassu10_en_5.4.2_3.0_1724388306627.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_prassu10","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_prassu10", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_prassu10| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/prassu10/flan-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_prassu10_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_prassu10_pipeline_en.md new file mode 100644 index 00000000000000..ade0db21d0fc76 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_prassu10_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_prassu10_pipeline pipeline T5Transformer from prassu10 +author: John Snow Labs +name: flan_t5_small_prassu10_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_prassu10_pipeline` is a English model originally trained by prassu10. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_prassu10_pipeline_en_5.4.2_3.0_1724388323275.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_prassu10_pipeline_en_5.4.2_3.0_1724388323275.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_prassu10_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_prassu10_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_prassu10_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/prassu10/flan-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samsum_yllkejashari_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samsum_yllkejashari_en.md new file mode 100644 index 00000000000000..f30857270842a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samsum_yllkejashari_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English flan_t5_small_samsum_yllkejashari T5Transformer from yllkejashari +author: John Snow Labs +name: flan_t5_small_samsum_yllkejashari +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_yllkejashari` is a English model originally trained by yllkejashari. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_yllkejashari_en_5.4.2_3.0_1724380884551.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_yllkejashari_en_5.4.2_3.0_1724380884551.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("flan_t5_small_samsum_yllkejashari","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("flan_t5_small_samsum_yllkejashari", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_yllkejashari| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/yllkejashari/flan-t5-small-samsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samsum_yllkejashari_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samsum_yllkejashari_pipeline_en.md new file mode 100644 index 00000000000000..c9cbd26e2de71a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-flan_t5_small_samsum_yllkejashari_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English flan_t5_small_samsum_yllkejashari_pipeline pipeline T5Transformer from yllkejashari +author: John Snow Labs +name: flan_t5_small_samsum_yllkejashari_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`flan_t5_small_samsum_yllkejashari_pipeline` is a English model originally trained by yllkejashari. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_yllkejashari_pipeline_en_5.4.2_3.0_1724380901828.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/flan_t5_small_samsum_yllkejashari_pipeline_en_5.4.2_3.0_1724380901828.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("flan_t5_small_samsum_yllkejashari_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("flan_t5_small_samsum_yllkejashari_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|flan_t5_small_samsum_yllkejashari_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/yllkejashari/flan-t5-small-samsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-google_flan_t5_large_770_finetuned_medical_data_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-google_flan_t5_large_770_finetuned_medical_data_2_en.md new file mode 100644 index 00000000000000..f1ce90935b31e0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-google_flan_t5_large_770_finetuned_medical_data_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English google_flan_t5_large_770_finetuned_medical_data_2 T5Transformer from nikhil928 +author: John Snow Labs +name: google_flan_t5_large_770_finetuned_medical_data_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`google_flan_t5_large_770_finetuned_medical_data_2` is a English model originally trained by nikhil928. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/google_flan_t5_large_770_finetuned_medical_data_2_en_5.4.2_3.0_1724401651486.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/google_flan_t5_large_770_finetuned_medical_data_2_en_5.4.2_3.0_1724401651486.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("google_flan_t5_large_770_finetuned_medical_data_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("google_flan_t5_large_770_finetuned_medical_data_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|google_flan_t5_large_770_finetuned_medical_data_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/nikhil928/google-flan-t5-large-770-finetuned-medical-data-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-google_flan_t5_large_770_finetuned_medical_data_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-google_flan_t5_large_770_finetuned_medical_data_2_pipeline_en.md new file mode 100644 index 00000000000000..f07fd5ae9724a8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-google_flan_t5_large_770_finetuned_medical_data_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English google_flan_t5_large_770_finetuned_medical_data_2_pipeline pipeline T5Transformer from nikhil928 +author: John Snow Labs +name: google_flan_t5_large_770_finetuned_medical_data_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`google_flan_t5_large_770_finetuned_medical_data_2_pipeline` is a English model originally trained by nikhil928. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/google_flan_t5_large_770_finetuned_medical_data_2_pipeline_en_5.4.2_3.0_1724402160924.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/google_flan_t5_large_770_finetuned_medical_data_2_pipeline_en_5.4.2_3.0_1724402160924.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("google_flan_t5_large_770_finetuned_medical_data_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("google_flan_t5_large_770_finetuned_medical_data_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|google_flan_t5_large_770_finetuned_medical_data_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/nikhil928/google-flan-t5-large-770-finetuned-medical-data-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-google_mt5_small_ibn_shaddad_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-google_mt5_small_ibn_shaddad_v1_en.md new file mode 100644 index 00000000000000..1bfd548c8cb7fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-google_mt5_small_ibn_shaddad_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English google_mt5_small_ibn_shaddad_v1 T5Transformer from Ahmed007 +author: John Snow Labs +name: google_mt5_small_ibn_shaddad_v1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`google_mt5_small_ibn_shaddad_v1` is a English model originally trained by Ahmed007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/google_mt5_small_ibn_shaddad_v1_en_5.4.2_3.0_1724388176438.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/google_mt5_small_ibn_shaddad_v1_en_5.4.2_3.0_1724388176438.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("google_mt5_small_ibn_shaddad_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("google_mt5_small_ibn_shaddad_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|google_mt5_small_ibn_shaddad_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|291.8 MB| + +## References + +https://huggingface.co/Ahmed007/google-mt5-small-ibn-Shaddad-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-google_mt5_small_ibn_shaddad_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-google_mt5_small_ibn_shaddad_v1_pipeline_en.md new file mode 100644 index 00000000000000..13d45a75fdb75b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-google_mt5_small_ibn_shaddad_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English google_mt5_small_ibn_shaddad_v1_pipeline pipeline T5Transformer from Ahmed007 +author: John Snow Labs +name: google_mt5_small_ibn_shaddad_v1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`google_mt5_small_ibn_shaddad_v1_pipeline` is a English model originally trained by Ahmed007. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/google_mt5_small_ibn_shaddad_v1_pipeline_en_5.4.2_3.0_1724388196335.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/google_mt5_small_ibn_shaddad_v1_pipeline_en_5.4.2_3.0_1724388196335.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("google_mt5_small_ibn_shaddad_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("google_mt5_small_ibn_shaddad_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|google_mt5_small_ibn_shaddad_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|291.8 MB| + +## References + +https://huggingface.co/Ahmed007/google-mt5-small-ibn-Shaddad-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-govreport_summarization_en.md b/docs/_posts/ahmedlone127/2024-08-23-govreport_summarization_en.md new file mode 100644 index 00000000000000..bf95677b1b2aa5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-govreport_summarization_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English govreport_summarization T5Transformer from Hemg +author: John Snow Labs +name: govreport_summarization +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`govreport_summarization` is a English model originally trained by Hemg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/govreport_summarization_en_5.4.2_3.0_1724380998458.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/govreport_summarization_en_5.4.2_3.0_1724380998458.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("govreport_summarization","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("govreport_summarization", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|govreport_summarization| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/Hemg/govreport-summarization \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-govreport_summarization_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-govreport_summarization_pipeline_en.md new file mode 100644 index 00000000000000..c376636b3209f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-govreport_summarization_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English govreport_summarization_pipeline pipeline T5Transformer from Hemg +author: John Snow Labs +name: govreport_summarization_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`govreport_summarization_pipeline` is a English model originally trained by Hemg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/govreport_summarization_pipeline_en_5.4.2_3.0_1724381014733.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/govreport_summarization_pipeline_en_5.4.2_3.0_1724381014733.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("govreport_summarization_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("govreport_summarization_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|govreport_summarization_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.0 MB| + +## References + +https://huggingface.co/Hemg/govreport-summarization + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ielts_gec_t5_jfleg_en.md b/docs/_posts/ahmedlone127/2024-08-23-ielts_gec_t5_jfleg_en.md new file mode 100644 index 00000000000000..8aaca85da1e7b3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ielts_gec_t5_jfleg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English ielts_gec_t5_jfleg T5Transformer from hafidikhsan +author: John Snow Labs +name: ielts_gec_t5_jfleg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ielts_gec_t5_jfleg` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ielts_gec_t5_jfleg_en_5.4.2_3.0_1724371645054.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ielts_gec_t5_jfleg_en_5.4.2_3.0_1724371645054.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("ielts_gec_t5_jfleg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("ielts_gec_t5_jfleg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ielts_gec_t5_jfleg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|984.7 MB| + +## References + +https://huggingface.co/hafidikhsan/IELTS-GEC-T5-JFLEG \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-ielts_gec_t5_jfleg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-ielts_gec_t5_jfleg_pipeline_en.md new file mode 100644 index 00000000000000..dc7264d774f5cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-ielts_gec_t5_jfleg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English ielts_gec_t5_jfleg_pipeline pipeline T5Transformer from hafidikhsan +author: John Snow Labs +name: ielts_gec_t5_jfleg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`ielts_gec_t5_jfleg_pipeline` is a English model originally trained by hafidikhsan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/ielts_gec_t5_jfleg_pipeline_en_5.4.2_3.0_1724371699543.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/ielts_gec_t5_jfleg_pipeline_en_5.4.2_3.0_1724371699543.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("ielts_gec_t5_jfleg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("ielts_gec_t5_jfleg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|ielts_gec_t5_jfleg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|984.7 MB| + +## References + +https://huggingface.co/hafidikhsan/IELTS-GEC-T5-JFLEG + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-k2t_2_keywords_en.md b/docs/_posts/ahmedlone127/2024-08-23-k2t_2_keywords_en.md new file mode 100644 index 00000000000000..d10587bbf19c3c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-k2t_2_keywords_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English k2t_2_keywords T5Transformer from taewhan +author: John Snow Labs +name: k2t_2_keywords +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_2_keywords` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_2_keywords_en_5.4.2_3.0_1724372191008.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_2_keywords_en_5.4.2_3.0_1724372191008.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("k2t_2_keywords","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("k2t_2_keywords", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_2_keywords| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.2 MB| + +## References + +https://huggingface.co/taewhan/k2t-2_keywords \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-k2t_2_keywords_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-k2t_2_keywords_pipeline_en.md new file mode 100644 index 00000000000000..6cf86cf25f0e5f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-k2t_2_keywords_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English k2t_2_keywords_pipeline pipeline T5Transformer from taewhan +author: John Snow Labs +name: k2t_2_keywords_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`k2t_2_keywords_pipeline` is a English model originally trained by taewhan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/k2t_2_keywords_pipeline_en_5.4.2_3.0_1724372208609.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/k2t_2_keywords_pipeline_en_5.4.2_3.0_1724372208609.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("k2t_2_keywords_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("k2t_2_keywords_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|k2t_2_keywords_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.2 MB| + +## References + +https://huggingface.co/taewhan/k2t-2_keywords + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-klsjfe_en.md b/docs/_posts/ahmedlone127/2024-08-23-klsjfe_en.md new file mode 100644 index 00000000000000..f1c7346783165f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-klsjfe_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English klsjfe T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: klsjfe +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`klsjfe` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/klsjfe_en_5.4.2_3.0_1724395801638.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/klsjfe_en_5.4.2_3.0_1724395801638.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("klsjfe","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("klsjfe", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|klsjfe| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|991.7 MB| + +## References + +https://huggingface.co/AliGhiasvand86/klsjfe \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-klsjfe_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-klsjfe_pipeline_en.md new file mode 100644 index 00000000000000..d611c8bb00de64 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-klsjfe_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English klsjfe_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: klsjfe_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`klsjfe_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/klsjfe_pipeline_en_5.4.2_3.0_1724395854275.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/klsjfe_pipeline_en_5.4.2_3.0_1724395854275.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("klsjfe_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("klsjfe_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|klsjfe_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|991.7 MB| + +## References + +https://huggingface.co/AliGhiasvand86/klsjfe + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_oaspl_v3_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_oaspl_v3_en.md new file mode 100644 index 00000000000000..e24ad3ccde6212 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_oaspl_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_oaspl_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_oaspl_v3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_oaspl_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_oaspl_v3_en_5.4.2_3.0_1724389589900.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_oaspl_v3_en_5.4.2_3.0_1724389589900.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_oaspl_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_oaspl_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_oaspl_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OASPL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_oaspl_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_oaspl_v3_pipeline_en.md new file mode 100644 index 00000000000000..81f1cea18b87c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_oaspl_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_oaspl_v3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_oaspl_v3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_oaspl_v3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_oaspl_v3_pipeline_en_5.4.2_3.0_1724389762755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_oaspl_v3_pipeline_en_5.4.2_3.0_1724389762755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_oaspl_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_oaspl_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_oaspl_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_OASPL_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_pasol_v3_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_pasol_v3_en.md new file mode 100644 index 00000000000000..3ba35dc45c156e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_pasol_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_pasol_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_pasol_v3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_pasol_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_pasol_v3_en_5.4.2_3.0_1724375877461.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_pasol_v3_en_5.4.2_3.0_1724375877461.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_pasol_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_pasol_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_pasol_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_PASOL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_apsol_v5_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_apsol_v5_en.md new file mode 100644 index 00000000000000..1bec53f2166273 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_apsol_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_apsol_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_apsol_v5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_apsol_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_apsol_v5_en_5.4.2_3.0_1724388910506.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_apsol_v5_en_5.4.2_3.0_1724388910506.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_apsol_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_apsol_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_apsol_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_APSOL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_apsol_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_apsol_v5_pipeline_en.md new file mode 100644 index 00000000000000..16dfea827ee036 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_apsol_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_apsol_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_apsol_v5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_apsol_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_apsol_v5_pipeline_en_5.4.2_3.0_1724389086782.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_apsol_v5_pipeline_en_5.4.2_3.0_1724389086782.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_apsol_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_apsol_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_apsol_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_APSOL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_posal_v3_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_posal_v3_en.md new file mode 100644 index 00000000000000..cd1ec29593b6c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_posal_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_posal_v3 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_posal_v3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_posal_v3` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_posal_v3_en_5.4.2_3.0_1724378686090.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_posal_v3_en_5.4.2_3.0_1724378686090.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_posal_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_posal_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_posal_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_POSAL_v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_posal_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_posal_v3_pipeline_en.md new file mode 100644 index 00000000000000..edf97c6b20b086 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_posal_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_posal_v3_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_posal_v3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_posal_v3_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_posal_v3_pipeline_en_5.4.2_3.0_1724378860796.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_posal_v3_pipeline_en_5.4.2_3.0_1724378860796.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_posal_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_posal_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_posal_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_POSAL_v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_psoal_v5_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_psoal_v5_en.md new file mode 100644 index 00000000000000..b00db438f0df6c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_psoal_v5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_psoal_v5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_psoal_v5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_psoal_v5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_psoal_v5_en_5.4.2_3.0_1724375603678.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_psoal_v5_en_5.4.2_3.0_1724375603678.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_psoal_v5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_psoal_v5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_psoal_v5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_PSOAL_v5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_psoal_v5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_psoal_v5_pipeline_en.md new file mode 100644 index 00000000000000..dad9be03cf166c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_psoal_v5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_psoal_v5_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_psoal_v5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_psoal_v5_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_psoal_v5_pipeline_en_5.4.2_3.0_1724375787599.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_psoal_v5_pipeline_en_5.4.2_3.0_1724375787599.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_psoal_v5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_psoal_v5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_psoal_v5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_PSOAL_v5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_en.md new file mode 100644 index 00000000000000..88000c67b26e9d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_en_5.4.2_3.0_1724383821436.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_en_5.4.2_3.0_1724383821436.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_test42_3_RS_SE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline_en.md new file mode 100644 index 00000000000000..e43dd2aea801e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline_en_5.4.2_3.0_1724383993857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline_en_5.4.2_3.0_1724383993857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_test42_3_RS_SE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test_rs_northern_sami_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test_rs_northern_sami_en.md new file mode 100644 index 00000000000000..50620edeacc534 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test_rs_northern_sami_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_test_rs_northern_sami T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_test_rs_northern_sami +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_test_rs_northern_sami` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test_rs_northern_sami_en_5.4.2_3.0_1724401428061.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test_rs_northern_sami_en_5.4.2_3.0_1724401428061.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_test_rs_northern_sami","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kltn_coqe_vit5_total_sapol_test_rs_northern_sami", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_test_rs_northern_sami| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_test_RS_SE \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline_en.md new file mode 100644 index 00000000000000..3aebb21d37ce71 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline pipeline T5Transformer from ThuyNT03 +author: John Snow Labs +name: kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline_en_5.4.2_3.0_1724401595516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline_en_5.4.2_3.0_1724401595516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/KLTN_COQE_viT5_total_SAPOL_test_RS_SE + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kt_flan_finphr_summ_en.md b/docs/_posts/ahmedlone127/2024-08-23-kt_flan_finphr_summ_en.md new file mode 100644 index 00000000000000..f365e64dffd951 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kt_flan_finphr_summ_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English kt_flan_finphr_summ T5Transformer from kelvinleong +author: John Snow Labs +name: kt_flan_finphr_summ +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kt_flan_finphr_summ` is a English model originally trained by kelvinleong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kt_flan_finphr_summ_en_5.4.2_3.0_1724389982665.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kt_flan_finphr_summ_en_5.4.2_3.0_1724389982665.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("kt_flan_finphr_summ","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("kt_flan_finphr_summ", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kt_flan_finphr_summ| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kelvinleong/KT_Flan_FinPhr_Summ \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-kt_flan_finphr_summ_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-kt_flan_finphr_summ_pipeline_en.md new file mode 100644 index 00000000000000..49700365cbe7eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-kt_flan_finphr_summ_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English kt_flan_finphr_summ_pipeline pipeline T5Transformer from kelvinleong +author: John Snow Labs +name: kt_flan_finphr_summ_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`kt_flan_finphr_summ_pipeline` is a English model originally trained by kelvinleong. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/kt_flan_finphr_summ_pipeline_en_5.4.2_3.0_1724390029889.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/kt_flan_finphr_summ_pipeline_en_5.4.2_3.0_1724390029889.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("kt_flan_finphr_summ_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("kt_flan_finphr_summ_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|kt_flan_finphr_summ_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/kelvinleong/KT_Flan_FinPhr_Summ + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-l2d_en.md b/docs/_posts/ahmedlone127/2024-08-23-l2d_en.md new file mode 100644 index 00000000000000..5539eaa0b9f467 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-l2d_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English l2d T5Transformer from CogComp +author: John Snow Labs +name: l2d +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`l2d` is a English model originally trained by CogComp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/l2d_en_5.4.2_3.0_1724385654446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/l2d_en_5.4.2_3.0_1724385654446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("l2d","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("l2d", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|l2d| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/CogComp/l2d \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-l2d_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-l2d_pipeline_en.md new file mode 100644 index 00000000000000..a05300b260d412 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-l2d_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English l2d_pipeline pipeline T5Transformer from CogComp +author: John Snow Labs +name: l2d_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`l2d_pipeline` is a English model originally trained by CogComp. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/l2d_pipeline_en_5.4.2_3.0_1724385812563.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/l2d_pipeline_en_5.4.2_3.0_1724385812563.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("l2d_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("l2d_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|l2d_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/CogComp/l2d + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_chunked_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_chunked_en.md new file mode 100644 index 00000000000000..015c9e862b1597 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_chunked_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_chunked T5Transformer from Ashreen +author: John Snow Labs +name: legal_t5_small_chunked +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_chunked` is a English model originally trained by Ashreen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_chunked_en_5.4.2_3.0_1724399855781.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_chunked_en_5.4.2_3.0_1724399855781.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_chunked","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_chunked", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_chunked| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.9 MB| + +## References + +https://huggingface.co/Ashreen/legal-t5-small-chunked \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_chunked_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_chunked_pipeline_en.md new file mode 100644 index 00000000000000..30711b4b83731d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_chunked_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_chunked_pipeline pipeline T5Transformer from Ashreen +author: John Snow Labs +name: legal_t5_small_chunked_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_chunked_pipeline` is a English model originally trained by Ashreen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_chunked_pipeline_en_5.4.2_3.0_1724399875261.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_chunked_pipeline_en_5.4.2_3.0_1724399875261.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_chunked_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_chunked_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_chunked_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.9 MB| + +## References + +https://huggingface.co/Ashreen/legal-t5-small-chunked + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_cls_multitask_spanish_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_cls_multitask_spanish_en.md new file mode 100644 index 00000000000000..7ad1374f02c937 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_cls_multitask_spanish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_cls_multitask_spanish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_multitask_spanish +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_multitask_spanish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_multitask_spanish_en_5.4.2_3.0_1724392337724.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_multitask_spanish_en_5.4.2_3.0_1724392337724.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_cls_multitask_spanish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_cls_multitask_spanish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_multitask_spanish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.6 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_multitask_es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_cls_multitask_spanish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_cls_multitask_spanish_pipeline_en.md new file mode 100644 index 00000000000000..3df044b8f1dbae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_cls_multitask_spanish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_cls_multitask_spanish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_cls_multitask_spanish_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_cls_multitask_spanish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_multitask_spanish_pipeline_en_5.4.2_3.0_1724392399777.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_cls_multitask_spanish_pipeline_en_5.4.2_3.0_1724392399777.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_cls_multitask_spanish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_cls_multitask_spanish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_cls_multitask_spanish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.6 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_cls_multitask_es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_czech_swedish_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_czech_swedish_en.md new file mode 100644 index 00000000000000..ebdc195e814d57 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_czech_swedish_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_multitask_czech_swedish T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_czech_swedish +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_czech_swedish` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_czech_swedish_en_5.4.2_3.0_1724384233104.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_czech_swedish_en_5.4.2_3.0_1724384233104.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_multitask_czech_swedish","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_multitask_czech_swedish", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_czech_swedish| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_cs_sv \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_czech_swedish_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_czech_swedish_pipeline_en.md new file mode 100644 index 00000000000000..61b13d7e5ddd9b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_multitask_czech_swedish_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_multitask_czech_swedish_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_multitask_czech_swedish_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_multitask_czech_swedish_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_czech_swedish_pipeline_en_5.4.2_3.0_1724384294544.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_multitask_czech_swedish_pipeline_en_5.4.2_3.0_1724384294544.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_multitask_czech_swedish_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_multitask_czech_swedish_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_multitask_czech_swedish_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_multitask_cs_sv + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_multitask_czech_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_multitask_czech_en.md new file mode 100644 index 00000000000000..c5eb3b85a416a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_multitask_czech_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_summ_multitask_czech T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_multitask_czech +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_multitask_czech` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_czech_en_5.4.2_3.0_1724376031141.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_czech_en_5.4.2_3.0_1724376031141.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_summ_multitask_czech","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_summ_multitask_czech", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_multitask_czech| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.7 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_multitask_cs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_multitask_czech_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_multitask_czech_pipeline_en.md new file mode 100644 index 00000000000000..8ff201d7529899 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_summ_multitask_czech_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_summ_multitask_czech_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_summ_multitask_czech_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_summ_multitask_czech_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_czech_pipeline_en_5.4.2_3.0_1724376091269.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_summ_multitask_czech_pipeline_en_5.4.2_3.0_1724376091269.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_summ_multitask_czech_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_summ_multitask_czech_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_summ_multitask_czech_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.7 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_summ_multitask_cs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_english_swedish_small_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_english_swedish_small_finetuned_en.md new file mode 100644 index 00000000000000..11e7fa9f734816 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_english_swedish_small_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English legal_t5_small_trans_english_swedish_small_finetuned T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_english_swedish_small_finetuned +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_english_swedish_small_finetuned` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_swedish_small_finetuned_en_5.4.2_3.0_1724386964839.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_swedish_small_finetuned_en_5.4.2_3.0_1724386964839.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("legal_t5_small_trans_english_swedish_small_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("legal_t5_small_trans_english_swedish_small_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_english_swedish_small_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_en_sv_small_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_english_swedish_small_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_english_swedish_small_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..316502a33b27f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-legal_t5_small_trans_english_swedish_small_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English legal_t5_small_trans_english_swedish_small_finetuned_pipeline pipeline T5Transformer from SEBIS +author: John Snow Labs +name: legal_t5_small_trans_english_swedish_small_finetuned_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`legal_t5_small_trans_english_swedish_small_finetuned_pipeline` is a English model originally trained by SEBIS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_swedish_small_finetuned_pipeline_en_5.4.2_3.0_1724387024567.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/legal_t5_small_trans_english_swedish_small_finetuned_pipeline_en_5.4.2_3.0_1724387024567.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("legal_t5_small_trans_english_swedish_small_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("legal_t5_small_trans_english_swedish_small_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|legal_t5_small_trans_english_swedish_small_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.5 MB| + +## References + +https://huggingface.co/SEBIS/legal_t5_small_trans_en_sv_small_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-lomonosov_basev1_en.md b/docs/_posts/ahmedlone127/2024-08-23-lomonosov_basev1_en.md new file mode 100644 index 00000000000000..912b433b57c178 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-lomonosov_basev1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lomonosov_basev1 T5Transformer from NikitaKukuzey +author: John Snow Labs +name: lomonosov_basev1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lomonosov_basev1` is a English model originally trained by NikitaKukuzey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lomonosov_basev1_en_5.4.2_3.0_1724392835988.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lomonosov_basev1_en_5.4.2_3.0_1724392835988.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lomonosov_basev1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lomonosov_basev1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lomonosov_basev1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/NikitaKukuzey/Lomonosov_basev1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-lomonosov_basev1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-lomonosov_basev1_pipeline_en.md new file mode 100644 index 00000000000000..6c44e6fdc5d488 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-lomonosov_basev1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lomonosov_basev1_pipeline pipeline T5Transformer from NikitaKukuzey +author: John Snow Labs +name: lomonosov_basev1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lomonosov_basev1_pipeline` is a English model originally trained by NikitaKukuzey. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lomonosov_basev1_pipeline_en_5.4.2_3.0_1724392838734.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lomonosov_basev1_pipeline_en_5.4.2_3.0_1724392838734.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lomonosov_basev1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lomonosov_basev1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lomonosov_basev1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/NikitaKukuzey/Lomonosov_basev1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-long_t5_local_base_alex2awesome_en.md b/docs/_posts/ahmedlone127/2024-08-23-long_t5_local_base_alex2awesome_en.md new file mode 100644 index 00000000000000..ddb8e67ae2021c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-long_t5_local_base_alex2awesome_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English long_t5_local_base_alex2awesome T5Transformer from alex2awesome +author: John Snow Labs +name: long_t5_local_base_alex2awesome +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`long_t5_local_base_alex2awesome` is a English model originally trained by alex2awesome. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/long_t5_local_base_alex2awesome_en_5.4.2_3.0_1724406461930.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/long_t5_local_base_alex2awesome_en_5.4.2_3.0_1724406461930.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("long_t5_local_base_alex2awesome","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("long_t5_local_base_alex2awesome", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|long_t5_local_base_alex2awesome| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.4 MB| + +## References + +https://huggingface.co/alex2awesome/long-t5-local-base \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-low12_en.md b/docs/_posts/ahmedlone127/2024-08-23-low12_en.md new file mode 100644 index 00000000000000..e78e86e576fdd7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-low12_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English low12 T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low12 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low12` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low12_en_5.4.2_3.0_1724404224845.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low12_en_5.4.2_3.0_1724404224845.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("low12","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("low12", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low12| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|986.7 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low12 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-low12_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-low12_pipeline_en.md new file mode 100644 index 00000000000000..7dc6a059904870 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-low12_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English low12_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low12_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low12_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low12_pipeline_en_5.4.2_3.0_1724404279804.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low12_pipeline_en_5.4.2_3.0_1724404279804.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("low12_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("low12_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low12_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|986.7 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low12 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-low2_en.md b/docs/_posts/ahmedlone127/2024-08-23-low2_en.md new file mode 100644 index 00000000000000..14cfcc6bf83480 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-low2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English low2 T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low2` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low2_en_5.4.2_3.0_1724373405965.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low2_en_5.4.2_3.0_1724373405965.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("low2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("low2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|971.3 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-low2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-low2_pipeline_en.md new file mode 100644 index 00000000000000..d06151690f44c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-low2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English low2_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low2_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low2_pipeline_en_5.4.2_3.0_1724373462725.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low2_pipeline_en_5.4.2_3.0_1724373462725.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("low2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("low2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|971.3 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-low4_en.md b/docs/_posts/ahmedlone127/2024-08-23-low4_en.md new file mode 100644 index 00000000000000..2c305f5895ab79 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-low4_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English low4 T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low4 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low4` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low4_en_5.4.2_3.0_1724400269945.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low4_en_5.4.2_3.0_1724400269945.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("low4","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("low4", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low4| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|972.4 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low4 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-low4_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-low4_pipeline_en.md new file mode 100644 index 00000000000000..1c827c468dce1f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-low4_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English low4_pipeline pipeline T5Transformer from AliGhiasvand86 +author: John Snow Labs +name: low4_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`low4_pipeline` is a English model originally trained by AliGhiasvand86. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/low4_pipeline_en_5.4.2_3.0_1724400327578.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/low4_pipeline_en_5.4.2_3.0_1724400327578.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("low4_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("low4_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|low4_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|972.4 MB| + +## References + +https://huggingface.co/AliGhiasvand86/low4 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-lt5_large2_en.md b/docs/_posts/ahmedlone127/2024-08-23-lt5_large2_en.md new file mode 100644 index 00000000000000..60bd8ee5e9c221 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-lt5_large2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English lt5_large2 T5Transformer from santoshtyss +author: John Snow Labs +name: lt5_large2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lt5_large2` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lt5_large2_en_5.4.2_3.0_1724374184446.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lt5_large2_en_5.4.2_3.0_1724374184446.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("lt5_large2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("lt5_large2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lt5_large2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/santoshtyss/lt5-large2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-lt5_large2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-lt5_large2_pipeline_en.md new file mode 100644 index 00000000000000..08683553f7c2f9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-lt5_large2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English lt5_large2_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: lt5_large2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`lt5_large2_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/lt5_large2_pipeline_en_5.4.2_3.0_1724374329341.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/lt5_large2_pipeline_en_5.4.2_3.0_1724374329341.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("lt5_large2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("lt5_large2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|lt5_large2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/santoshtyss/lt5-large2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-msrp_ratio_sb_en.md b/docs/_posts/ahmedlone127/2024-08-23-msrp_ratio_sb_en.md new file mode 100644 index 00000000000000..5378b420a1b50d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-msrp_ratio_sb_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English msrp_ratio_sb T5Transformer from anonsubms +author: John Snow Labs +name: msrp_ratio_sb +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`msrp_ratio_sb` is a English model originally trained by anonsubms. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/msrp_ratio_sb_en_5.4.2_3.0_1724385884017.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/msrp_ratio_sb_en_5.4.2_3.0_1724385884017.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("msrp_ratio_sb","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("msrp_ratio_sb", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|msrp_ratio_sb| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|312.5 MB| + +## References + +https://huggingface.co/anonsubms/msrp_ratio_sb \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-msrp_ratio_sb_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-msrp_ratio_sb_pipeline_en.md new file mode 100644 index 00000000000000..1e8345d4bea211 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-msrp_ratio_sb_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English msrp_ratio_sb_pipeline pipeline T5Transformer from anonsubms +author: John Snow Labs +name: msrp_ratio_sb_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`msrp_ratio_sb_pipeline` is a English model originally trained by anonsubms. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/msrp_ratio_sb_pipeline_en_5.4.2_3.0_1724385902193.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/msrp_ratio_sb_pipeline_en_5.4.2_3.0_1724385902193.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("msrp_ratio_sb_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("msrp_ratio_sb_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|msrp_ratio_sb_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|312.5 MB| + +## References + +https://huggingface.co/anonsubms/msrp_ratio_sb + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_all_150000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_all_150000_en.md new file mode 100644 index 00000000000000..3f580e8cf8ed36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_all_150000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_all_150000 T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_base_all_150000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_all_150000` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_all_150000_en_5.4.2_3.0_1724403226644.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_all_150000_en_5.4.2_3.0_1724403226644.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_all_150000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_all_150000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_all_150000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_base_all_150000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_all_150000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_all_150000_pipeline_en.md new file mode 100644 index 00000000000000..b432691db35fb6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_all_150000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_all_150000_pipeline pipeline T5Transformer from santoshtyss +author: John Snow Labs +name: mt5_base_all_150000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_all_150000_pipeline` is a English model originally trained by santoshtyss. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_all_150000_pipeline_en_5.4.2_3.0_1724403415764.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_all_150000_pipeline_en_5.4.2_3.0_1724403415764.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_all_150000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_all_150000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_all_150000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.7 GB| + +## References + +https://huggingface.co/santoshtyss/mt5_base_all_150000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_dequad_qg_trimmed_15000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_dequad_qg_trimmed_15000_en.md new file mode 100644 index 00000000000000..e713f61aa7ef15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_dequad_qg_trimmed_15000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_dequad_qg_trimmed_15000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_dequad_qg_trimmed_15000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_qg_trimmed_15000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_trimmed_15000_en_5.4.2_3.0_1724405511816.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_trimmed_15000_en_5.4.2_3.0_1724405511816.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_dequad_qg_trimmed_15000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_dequad_qg_trimmed_15000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_qg_trimmed_15000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|869.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-dequad-qg-trimmed-15000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_dequad_qg_trimmed_15000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_dequad_qg_trimmed_15000_pipeline_en.md new file mode 100644 index 00000000000000..089190bf6fbc37 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_dequad_qg_trimmed_15000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_dequad_qg_trimmed_15000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_dequad_qg_trimmed_15000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_dequad_qg_trimmed_15000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_trimmed_15000_pipeline_en_5.4.2_3.0_1724405553977.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_dequad_qg_trimmed_15000_pipeline_en_5.4.2_3.0_1724405553977.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_dequad_qg_trimmed_15000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_dequad_qg_trimmed_15000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_dequad_qg_trimmed_15000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|869.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-dequad-qg-trimmed-15000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_en.md new file mode 100644 index 00000000000000..f4fd08a544e23e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation T5Transformer from airKlizz +author: John Snow Labs +name: mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_en_5.4.2_3.0_1724387698743.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_en_5.4.2_3.0_1724387698743.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/airKlizz/mt5-base-germeval21-toxic-with-task-specific-pretraining-and-data-augmentation \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline_en.md new file mode 100644 index 00000000000000..5f162ab7534058 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline pipeline T5Transformer from airKlizz +author: John Snow Labs +name: mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline` is a English model originally trained by airKlizz. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline_en_5.4.2_3.0_1724387842510.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline_en_5.4.2_3.0_1724387842510.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/airKlizz/mt5-base-germeval21-toxic-with-task-specific-pretraining-and-data-augmentation + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_gramatika_e8_b16_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_gramatika_e8_b16_en.md new file mode 100644 index 00000000000000..4ce9308e0c7df8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_gramatika_e8_b16_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_gramatika_e8_b16 T5Transformer from jeremyvictor +author: John Snow Labs +name: mt5_base_gramatika_e8_b16 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_gramatika_e8_b16` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_gramatika_e8_b16_en_5.4.2_3.0_1724396600007.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_gramatika_e8_b16_en_5.4.2_3.0_1724396600007.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_gramatika_e8_b16","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_gramatika_e8_b16", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_gramatika_e8_b16| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/jeremyvictor/mt5-base-gramatika-e8-b16 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_gramatika_e8_b16_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_gramatika_e8_b16_pipeline_en.md new file mode 100644 index 00000000000000..6f396cead0d329 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_gramatika_e8_b16_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_gramatika_e8_b16_pipeline pipeline T5Transformer from jeremyvictor +author: John Snow Labs +name: mt5_base_gramatika_e8_b16_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_gramatika_e8_b16_pipeline` is a English model originally trained by jeremyvictor. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_gramatika_e8_b16_pipeline_en_5.4.2_3.0_1724396934755.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_gramatika_e8_b16_pipeline_en_5.4.2_3.0_1724396934755.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_gramatika_e8_b16_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_gramatika_e8_b16_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_gramatika_e8_b16_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/jeremyvictor/mt5-base-gramatika-e8-b16 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_nc16_10k_ende_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_nc16_10k_ende_en.md new file mode 100644 index 00000000000000..53a09331ef5943 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_nc16_10k_ende_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_nc16_10k_ende T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_10k_ende +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_10k_ende` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_10k_ende_en_5.4.2_3.0_1724400571799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_10k_ende_en_5.4.2_3.0_1724400571799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_nc16_10k_ende","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_nc16_10k_ende", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_10k_ende| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-10k-ende \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_nc16_10k_ende_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_nc16_10k_ende_pipeline_en.md new file mode 100644 index 00000000000000..4be0477476fa0c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_nc16_10k_ende_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_nc16_10k_ende_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_base_nc16_10k_ende_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_nc16_10k_ende_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_10k_ende_pipeline_en_5.4.2_3.0_1724400869857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_nc16_10k_ende_pipeline_en_5.4.2_3.0_1724400869857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_nc16_10k_ende_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_nc16_10k_ende_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_nc16_10k_ende_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/leukas/mt5-base-nc16-10k-ende + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_ruquad_qg_ae_trimmed_50000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_ruquad_qg_ae_trimmed_50000_en.md new file mode 100644 index 00000000000000..17944719b08044 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_ruquad_qg_ae_trimmed_50000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_ruquad_qg_ae_trimmed_50000 T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_ruquad_qg_ae_trimmed_50000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ruquad_qg_ae_trimmed_50000` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724389792950.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_ae_trimmed_50000_en_5.4.2_3.0_1724389792950.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_ruquad_qg_ae_trimmed_50000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_ruquad_qg_ae_trimmed_50000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ruquad_qg_ae_trimmed_50000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-ruquad-qg-ae-trimmed-50000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_ruquad_qg_ae_trimmed_50000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_ruquad_qg_ae_trimmed_50000_pipeline_en.md new file mode 100644 index 00000000000000..53ce3623251675 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_ruquad_qg_ae_trimmed_50000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_ruquad_qg_ae_trimmed_50000_pipeline pipeline T5Transformer from lmqg +author: John Snow Labs +name: mt5_base_ruquad_qg_ae_trimmed_50000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_ruquad_qg_ae_trimmed_50000_pipeline` is a English model originally trained by lmqg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724389852029.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_ruquad_qg_ae_trimmed_50000_pipeline_en_5.4.2_3.0_1724389852029.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_ruquad_qg_ae_trimmed_50000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_ruquad_qg_ae_trimmed_50000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_ruquad_qg_ae_trimmed_50000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/lmqg/mt5-base-ruquad-qg-ae-trimmed-50000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_105000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_105000_en.md new file mode 100644 index 00000000000000..1ab511849de05e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_105000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_base_trimmed_german_105000 T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_105000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_105000` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_105000_en_5.4.2_3.0_1724376298128.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_105000_en_5.4.2_3.0_1724376298128.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_base_trimmed_german_105000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_base_trimmed_german_105000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_105000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|843.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-105000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_105000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_105000_pipeline_en.md new file mode 100644 index 00000000000000..261292734c5fd8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_base_trimmed_german_105000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_base_trimmed_german_105000_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: mt5_base_trimmed_german_105000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_base_trimmed_german_105000_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_105000_pipeline_en_5.4.2_3.0_1724376580311.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_base_trimmed_german_105000_pipeline_en_5.4.2_3.0_1724376580311.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_base_trimmed_german_105000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_base_trimmed_german_105000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_base_trimmed_german_105000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|843.5 MB| + +## References + +https://huggingface.co/research-backup/mt5-base-trimmed-de-105000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_english_lug_news_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_lug_news_en.md new file mode 100644 index 00000000000000..e5a069b1373391 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_lug_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_english_lug_news T5Transformer from masakhane +author: John Snow Labs +name: mt5_english_lug_news +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_lug_news` is a English model originally trained by masakhane. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_lug_news_en_5.4.2_3.0_1724394056343.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_lug_news_en_5.4.2_3.0_1724394056343.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_english_lug_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_english_lug_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_lug_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.2 GB| + +## References + +https://huggingface.co/masakhane/mt5_en_lug_news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_english_rr_100_norwegian_bokml_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_rr_100_norwegian_bokml_en.md new file mode 100644 index 00000000000000..64e18f0fc7c2e1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_rr_100_norwegian_bokml_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_english_rr_100_norwegian_bokml T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_english_rr_100_norwegian_bokml +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_rr_100_norwegian_bokml` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_rr_100_norwegian_bokml_en_5.4.2_3.0_1724403905979.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_rr_100_norwegian_bokml_en_5.4.2_3.0_1724403905979.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_english_rr_100_norwegian_bokml","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_english_rr_100_norwegian_bokml", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_rr_100_norwegian_bokml| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-en-rr-100-nb \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_english_rr_100_norwegian_bokml_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_rr_100_norwegian_bokml_pipeline_en.md new file mode 100644 index 00000000000000..8cc68f0beb829f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_english_rr_100_norwegian_bokml_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_english_rr_100_norwegian_bokml_pipeline pipeline T5Transformer from MarianaLC +author: John Snow Labs +name: mt5_english_rr_100_norwegian_bokml_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_english_rr_100_norwegian_bokml_pipeline` is a English model originally trained by MarianaLC. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_english_rr_100_norwegian_bokml_pipeline_en_5.4.2_3.0_1724404132965.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_english_rr_100_norwegian_bokml_pipeline_en_5.4.2_3.0_1724404132965.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_english_rr_100_norwegian_bokml_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_english_rr_100_norwegian_bokml_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_english_rr_100_norwegian_bokml_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/MarianaLC/mt5-en-rr-100-nb + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_finetuned_amazon_english_spanish_accelerate_sebastians_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_finetuned_amazon_english_spanish_accelerate_sebastians_en.md new file mode 100644 index 00000000000000..f13d8cf9fb5f3d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_finetuned_amazon_english_spanish_accelerate_sebastians_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_sebastians T5Transformer from SebastianS +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_sebastians +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_sebastians` is a English model originally trained by SebastianS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_sebastians_en_5.4.2_3.0_1724397962548.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_sebastians_en_5.4.2_3.0_1724397962548.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_sebastians","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_finetuned_amazon_english_spanish_accelerate_sebastians", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_sebastians| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/SebastianS/mt5-finetuned-amazon-en-es-accelerate \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline_en.md new file mode 100644 index 00000000000000..9dc389cdc72c8f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline pipeline T5Transformer from SebastianS +author: John Snow Labs +name: mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline` is a English model originally trained by SebastianS. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline_en_5.4.2_3.0_1724398106376.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline_en_5.4.2_3.0_1724398106376.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/SebastianS/mt5-finetuned-amazon-en-es-accelerate + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_slovaksum_large_32_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_slovaksum_large_32_en.md new file mode 100644 index 00000000000000..e7fb5ec558c139 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_slovaksum_large_32_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_slovaksum_large_32 T5Transformer from kiviki +author: John Snow Labs +name: mt5_slovaksum_large_32 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_slovaksum_large_32` is a English model originally trained by kiviki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_slovaksum_large_32_en_5.4.2_3.0_1724384516315.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_slovaksum_large_32_en_5.4.2_3.0_1724384516315.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_slovaksum_large_32","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_slovaksum_large_32", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_slovaksum_large_32| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/kiviki/mt5-slovaksum-large-32 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_slovaksum_large_32_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_slovaksum_large_32_pipeline_en.md new file mode 100644 index 00000000000000..e9de57fdb80490 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_slovaksum_large_32_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_slovaksum_large_32_pipeline pipeline T5Transformer from kiviki +author: John Snow Labs +name: mt5_slovaksum_large_32_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_slovaksum_large_32_pipeline` is a English model originally trained by kiviki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_slovaksum_large_32_pipeline_en_5.4.2_3.0_1724384656277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_slovaksum_large_32_pipeline_en_5.4.2_3.0_1724384656277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_slovaksum_large_32_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_slovaksum_large_32_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_slovaksum_large_32_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.4 GB| + +## References + +https://huggingface.co/kiviki/mt5-slovaksum-large-32 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24jan_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24jan_1_en.md new file mode 100644 index 00000000000000..f6be375817f872 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24jan_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_24jan_1 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_24jan_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_24jan_1` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24jan_1_en_5.4.2_3.0_1724384142519.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24jan_1_en_5.4.2_3.0_1724384142519.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_24jan_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_24jan_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_24jan_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-24jan-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24jan_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24jan_1_pipeline_en.md new file mode 100644 index 00000000000000..160bc691306eb4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_24jan_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_24jan_1_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_24jan_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_24jan_1_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24jan_1_pipeline_en_5.4.2_3.0_1724384251252.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_24jan_1_pipeline_en_5.4.2_3.0_1724384251252.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_24jan_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_24jan_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_24jan_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-24jan-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_26jan_5_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_26jan_5_en.md new file mode 100644 index 00000000000000..72145d91673b8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_26jan_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_26jan_5 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_26jan_5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_26jan_5` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_5_en_5.4.2_3.0_1724372998718.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_5_en_5.4.2_3.0_1724372998718.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_26jan_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_26jan_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_26jan_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-26jan-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_26jan_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_26jan_5_pipeline_en.md new file mode 100644 index 00000000000000..ea12978c388c9d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_26jan_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_26jan_5_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_finetuned_26jan_5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_26jan_5_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_5_pipeline_en_5.4.2_3.0_1724373093751.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_26jan_5_pipeline_en_5.4.2_3.0_1724373093751.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_26jan_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_26jan_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_26jan_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-finetuned-26jan-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_anwar101_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_anwar101_en.md new file mode 100644 index 00000000000000..cda499b6eaad0e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_anwar101_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_anwar101 T5Transformer from ANWAR101 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_anwar101 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_anwar101` is a English model originally trained by ANWAR101. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_anwar101_en_5.4.2_3.0_1724404563795.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_anwar101_en_5.4.2_3.0_1724404563795.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_anwar101","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_anwar101", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_anwar101| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ANWAR101/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline_en.md new file mode 100644 index 00000000000000..00db4fb11d6d44 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline pipeline T5Transformer from ANWAR101 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline` is a English model originally trained by ANWAR101. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline_en_5.4.2_3.0_1724404686716.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline_en_5.4.2_3.0_1724404686716.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ANWAR101/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_chriskalahiki_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_chriskalahiki_en.md new file mode 100644 index 00000000000000..ee607065f828e3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_chriskalahiki_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_chriskalahiki T5Transformer from ChrisKalahiki +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_chriskalahiki +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_chriskalahiki` is a English model originally trained by ChrisKalahiki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_chriskalahiki_en_5.4.2_3.0_1724399985132.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_chriskalahiki_en_5.4.2_3.0_1724399985132.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_chriskalahiki","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_chriskalahiki", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_chriskalahiki| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ChrisKalahiki/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline_en.md new file mode 100644 index 00000000000000..a33f3cf70ed437 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline pipeline T5Transformer from ChrisKalahiki +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline` is a English model originally trained by ChrisKalahiki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline_en_5.4.2_3.0_1724400099974.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline_en_5.4.2_3.0_1724400099974.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/ChrisKalahiki/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_ep9_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_ep9_en.md new file mode 100644 index 00000000000000..2ca56ebbd784fc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_ep9_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_ep9 T5Transformer from EP9 +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_ep9 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_ep9` is a English model originally trained by EP9. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_ep9_en_5.4.2_3.0_1724406363120.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_ep9_en_5.4.2_3.0_1724406363120.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_ep9","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_ep9", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_ep9| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/EP9/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_smartpy_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_smartpy_en.md new file mode 100644 index 00000000000000..94021ac2bf8950 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_smartpy_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_smartpy T5Transformer from SmartPy +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_smartpy +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_smartpy` is a English model originally trained by SmartPy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_smartpy_en_5.4.2_3.0_1724374586322.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_smartpy_en_5.4.2_3.0_1724374586322.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_smartpy","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_smartpy", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_smartpy| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/SmartPy/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline_en.md new file mode 100644 index 00000000000000..18c0a1338e368c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline pipeline T5Transformer from SmartPy +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline` is a English model originally trained by SmartPy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline_en_5.4.2_3.0_1724374699287.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline_en_5.4.2_3.0_1724374699287.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_smartpy_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/SmartPy/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_youngjo_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_youngjo_en.md new file mode 100644 index 00000000000000..6d5e290dacb408 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_youngjo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_youngjo T5Transformer from YoungJo +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_youngjo +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_youngjo` is a English model originally trained by YoungJo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_youngjo_en_5.4.2_3.0_1724399266942.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_youngjo_en_5.4.2_3.0_1724399266942.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_youngjo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_amazon_english_spanish_youngjo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_youngjo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/YoungJo/mt5-small-finetuned-amazon-en-es \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline_en.md new file mode 100644 index 00000000000000..5685affa5d81c9 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline pipeline T5Transformer from YoungJo +author: John Snow Labs +name: mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline` is a English model originally trained by YoungJo. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline_en_5.4.2_3.0_1724399379721.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline_en_5.4.2_3.0_1724399379721.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/YoungJo/mt5-small-finetuned-amazon-en-es + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_slovak_news_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_slovak_news_en.md new file mode 100644 index 00000000000000..1c2ab0a1a3f3b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_slovak_news_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_slovak_news T5Transformer from kiviki +author: John Snow Labs +name: mt5_small_finetuned_slovak_news +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_slovak_news` is a English model originally trained by kiviki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_slovak_news_en_5.4.2_3.0_1724387821256.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_slovak_news_en_5.4.2_3.0_1724387821256.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_slovak_news","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_slovak_news", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_slovak_news| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/kiviki/mt5-small-finetuned-sk-news \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_slovak_news_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_slovak_news_pipeline_en.md new file mode 100644 index 00000000000000..fe2567125c0cea --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_slovak_news_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_slovak_news_pipeline pipeline T5Transformer from kiviki +author: John Snow Labs +name: mt5_small_finetuned_slovak_news_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_slovak_news_pipeline` is a English model originally trained by kiviki. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_slovak_news_pipeline_en_5.4.2_3.0_1724387936333.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_slovak_news_pipeline_en_5.4.2_3.0_1724387936333.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_slovak_news_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_slovak_news_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_slovak_news_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/kiviki/mt5-small-finetuned-sk-news + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_xsum_smartik_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_xsum_smartik_en.md new file mode 100644 index 00000000000000..b14d6b760c998f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_xsum_smartik_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_finetuned_xsum_smartik T5Transformer from smartik +author: John Snow Labs +name: mt5_small_finetuned_xsum_smartik +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_xsum_smartik` is a English model originally trained by smartik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xsum_smartik_en_5.4.2_3.0_1724382930436.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xsum_smartik_en_5.4.2_3.0_1724382930436.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_finetuned_xsum_smartik","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_finetuned_xsum_smartik", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_xsum_smartik| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/smartik/mt5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_xsum_smartik_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_xsum_smartik_pipeline_en.md new file mode 100644 index 00000000000000..c3e8775c1b6daa --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_finetuned_xsum_smartik_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_finetuned_xsum_smartik_pipeline pipeline T5Transformer from smartik +author: John Snow Labs +name: mt5_small_finetuned_xsum_smartik_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_finetuned_xsum_smartik_pipeline` is a English model originally trained by smartik. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xsum_smartik_pipeline_en_5.4.2_3.0_1724383211801.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_finetuned_xsum_smartik_pipeline_en_5.4.2_3.0_1724383211801.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_finetuned_xsum_smartik_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_finetuned_xsum_smartik_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_finetuned_xsum_smartik_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/smartik/mt5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_fs_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_fs_1_en.md new file mode 100644 index 00000000000000..b5f9a513d3c9f8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_fs_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_fs_1 T5Transformer from mqy +author: John Snow Labs +name: mt5_small_fs_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_fs_1` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_fs_1_en_5.4.2_3.0_1724382355650.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_fs_1_en_5.4.2_3.0_1724382355650.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_fs_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_fs_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_fs_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-fs-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_fs_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_fs_1_pipeline_en.md new file mode 100644 index 00000000000000..c908cb091ea912 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_fs_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_fs_1_pipeline pipeline T5Transformer from mqy +author: John Snow Labs +name: mt5_small_fs_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_fs_1_pipeline` is a English model originally trained by mqy. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_fs_1_pipeline_en_5.4.2_3.0_1724382463375.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_fs_1_pipeline_en_5.4.2_3.0_1724382463375.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_fs_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_fs_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_fs_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/mqy/mt5-small-fs-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_mid_lr_mid_decay_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_mid_lr_mid_decay_en.md new file mode 100644 index 00000000000000..a561ab675d592c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_mid_lr_mid_decay_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_mid_lr_mid_decay T5Transformer from psxjp5 +author: John Snow Labs +name: mt5_small_mid_lr_mid_decay +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mid_lr_mid_decay` is a English model originally trained by psxjp5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mid_lr_mid_decay_en_5.4.2_3.0_1724391752278.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mid_lr_mid_decay_en_5.4.2_3.0_1724391752278.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_mid_lr_mid_decay","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_mid_lr_mid_decay", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mid_lr_mid_decay| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/psxjp5/mt5-small_mid_lr_mid_decay \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_mid_lr_mid_decay_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_mid_lr_mid_decay_pipeline_en.md new file mode 100644 index 00000000000000..c4a69ef78bab58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_mid_lr_mid_decay_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_mid_lr_mid_decay_pipeline pipeline T5Transformer from psxjp5 +author: John Snow Labs +name: mt5_small_mid_lr_mid_decay_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_mid_lr_mid_decay_pipeline` is a English model originally trained by psxjp5. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_mid_lr_mid_decay_pipeline_en_5.4.2_3.0_1724391836385.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_mid_lr_mid_decay_pipeline_en_5.4.2_3.0_1724391836385.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_mid_lr_mid_decay_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_mid_lr_mid_decay_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_mid_lr_mid_decay_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/psxjp5/mt5-small_mid_lr_mid_decay + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_nc16_400_enes_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_nc16_400_enes_en.md new file mode 100644 index 00000000000000..1b7d1e59ea7fd0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_nc16_400_enes_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_nc16_400_enes T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_400_enes +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_400_enes` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_enes_en_5.4.2_3.0_1724394005138.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_enes_en_5.4.2_3.0_1724394005138.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_nc16_400_enes","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_nc16_400_enes", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_400_enes| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-400-enes \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_nc16_400_enes_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_nc16_400_enes_pipeline_en.md new file mode 100644 index 00000000000000..2314a1523c5d85 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_nc16_400_enes_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_nc16_400_enes_pipeline pipeline T5Transformer from leukas +author: John Snow Labs +name: mt5_small_nc16_400_enes_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_nc16_400_enes_pipeline` is a English model originally trained by leukas. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_enes_pipeline_en_5.4.2_3.0_1724394199731.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_nc16_400_enes_pipeline_en_5.4.2_3.0_1724394199731.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_nc16_400_enes_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_nc16_400_enes_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_nc16_400_enes_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.1 GB| + +## References + +https://huggingface.co/leukas/mt5-small-nc16-400-enes + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_5000_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_5000_en.md new file mode 100644 index 00000000000000..49e0951f729005 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_5000_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_small_trimmed_english_5000 T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_5000 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_5000` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_5000_en_5.4.2_3.0_1724404918081.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_5000_en_5.4.2_3.0_1724404918081.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_english_5000","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_english_5000", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_5000| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|101.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-5000 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_5000_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_5000_pipeline_en.md new file mode 100644 index 00000000000000..f75454921a8bd7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_english_5000_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_small_trimmed_english_5000_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_english_5000_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_english_5000_pipeline` is a English model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_5000_pipeline_en_5.4.2_3.0_1724404952267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_english_5000_pipeline_en_5.4.2_3.0_1724404952267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_english_5000_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_english_5000_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_english_5000_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|101.5 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-en-5000 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_120000_frquad_qa_fr.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_120000_frquad_qa_fr.md new file mode 100644 index 00000000000000..e3d17fdacac03e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_120000_frquad_qa_fr.md @@ -0,0 +1,86 @@ +--- +layout: model +title: French mt5_small_trimmed_french_120000_frquad_qa T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_120000_frquad_qa +date: 2024-08-23 +tags: [fr, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_120000_frquad_qa` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_frquad_qa_fr_5.4.2_3.0_1724403870508.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_frquad_qa_fr_5.4.2_3.0_1724403870508.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_french_120000_frquad_qa","fr") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_french_120000_frquad_qa", "fr") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_120000_frquad_qa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|fr| +|Size:|701.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-120000-frquad-qa \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_120000_frquad_qa_pipeline_fr.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_120000_frquad_qa_pipeline_fr.md new file mode 100644 index 00000000000000..590b3acc79281a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_french_120000_frquad_qa_pipeline_fr.md @@ -0,0 +1,69 @@ +--- +layout: model +title: French mt5_small_trimmed_french_120000_frquad_qa_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_french_120000_frquad_qa_pipeline +date: 2024-08-23 +tags: [fr, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: fr +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_french_120000_frquad_qa_pipeline` is a French model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_frquad_qa_pipeline_fr_5.4.2_3.0_1724403917024.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_french_120000_frquad_qa_pipeline_fr_5.4.2_3.0_1724403917024.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_french_120000_frquad_qa_pipeline", lang = "fr") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_french_120000_frquad_qa_pipeline", lang = "fr") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_french_120000_frquad_qa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|fr| +|Size:|701.1 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-fr-120000-frquad-qa + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_ruquad_qg_pipeline_ru.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_ruquad_qg_pipeline_ru.md new file mode 100644 index 00000000000000..98633f0e52e348 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_ruquad_qg_pipeline_ru.md @@ -0,0 +1,69 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_ruquad_qg_pipeline pipeline T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_ruquad_qg_pipeline +date: 2024-08-23 +tags: [ru, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_ruquad_qg_pipeline` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_ruquad_qg_pipeline_ru_5.4.2_3.0_1724387466300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_ruquad_qg_pipeline_ru_5.4.2_3.0_1724387466300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_small_trimmed_russian_ruquad_qg_pipeline", lang = "ru") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_small_trimmed_russian_ruquad_qg_pipeline", lang = "ru") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_ruquad_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|ru| +|Size:|825.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-ruquad-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_ruquad_qg_ru.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_ruquad_qg_ru.md new file mode 100644 index 00000000000000..2081a203eb53ac --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_small_trimmed_russian_ruquad_qg_ru.md @@ -0,0 +1,86 @@ +--- +layout: model +title: Russian mt5_small_trimmed_russian_ruquad_qg T5Transformer from vocabtrimmer +author: John Snow Labs +name: mt5_small_trimmed_russian_ruquad_qg +date: 2024-08-23 +tags: [ru, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: ru +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_small_trimmed_russian_ruquad_qg` is a Russian model originally trained by vocabtrimmer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_ruquad_qg_ru_5.4.2_3.0_1724387412341.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_small_trimmed_russian_ruquad_qg_ru_5.4.2_3.0_1724387412341.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_ruquad_qg","ru") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_small_trimmed_russian_ruquad_qg", "ru") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_small_trimmed_russian_ruquad_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|ru| +|Size:|825.6 MB| + +## References + +https://huggingface.co/vocabtrimmer/mt5-small-trimmed-ru-ruquad-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_russian_rut5_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_russian_rut5_en.md new file mode 100644 index 00000000000000..9b794183eace53 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_russian_rut5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_summarize_russian_rut5 T5Transformer from doktan +author: John Snow Labs +name: mt5_summarize_russian_rut5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarize_russian_rut5` is a English model originally trained by doktan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarize_russian_rut5_en_5.4.2_3.0_1724382814141.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarize_russian_rut5_en_5.4.2_3.0_1724382814141.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_summarize_russian_rut5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_summarize_russian_rut5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarize_russian_rut5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/doktan/mt5-summarize-ru-rut5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_russian_rut5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_russian_rut5_pipeline_en.md new file mode 100644 index 00000000000000..84bf172917d0a0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_russian_rut5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_summarize_russian_rut5_pipeline pipeline T5Transformer from doktan +author: John Snow Labs +name: mt5_summarize_russian_rut5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarize_russian_rut5_pipeline` is a English model originally trained by doktan. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarize_russian_rut5_pipeline_en_5.4.2_3.0_1724382862799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarize_russian_rut5_pipeline_en_5.4.2_3.0_1724382862799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_summarize_russian_rut5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_summarize_russian_rut5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarize_russian_rut5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/doktan/mt5-summarize-ru-rut5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_sum_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_sum_en.md new file mode 100644 index 00000000000000..d9628f449eb836 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_sum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_summarize_sum T5Transformer from raquelclemente +author: John Snow Labs +name: mt5_summarize_sum +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarize_sum` is a English model originally trained by raquelclemente. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarize_sum_en_5.4.2_3.0_1724400822342.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarize_sum_en_5.4.2_3.0_1724400822342.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_summarize_sum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_summarize_sum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarize_sum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/raquelclemente/mt5-summarize-sum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_sum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_sum_pipeline_en.md new file mode 100644 index 00000000000000..6df2d38f25d790 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_summarize_sum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_summarize_sum_pipeline pipeline T5Transformer from raquelclemente +author: John Snow Labs +name: mt5_summarize_sum_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summarize_sum_pipeline` is a English model originally trained by raquelclemente. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summarize_sum_pipeline_en_5.4.2_3.0_1724400976641.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summarize_sum_pipeline_en_5.4.2_3.0_1724400976641.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_summarize_sum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_summarize_sum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summarize_sum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.3 GB| + +## References + +https://huggingface.co/raquelclemente/mt5-summarize-sum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_summnerizing_russian_10_epochs_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_summnerizing_russian_10_epochs_en.md new file mode 100644 index 00000000000000..6d7e40d95593eb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_summnerizing_russian_10_epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_summnerizing_russian_10_epochs T5Transformer from Biakko +author: John Snow Labs +name: mt5_summnerizing_russian_10_epochs +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summnerizing_russian_10_epochs` is a English model originally trained by Biakko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summnerizing_russian_10_epochs_en_5.4.2_3.0_1724386803589.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summnerizing_russian_10_epochs_en_5.4.2_3.0_1724386803589.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_summnerizing_russian_10_epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_summnerizing_russian_10_epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summnerizing_russian_10_epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Biakko/mt5_summnerizing_ru_10_epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_summnerizing_russian_10_epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_summnerizing_russian_10_epochs_pipeline_en.md new file mode 100644 index 00000000000000..cadc28c1ffaca3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_summnerizing_russian_10_epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_summnerizing_russian_10_epochs_pipeline pipeline T5Transformer from Biakko +author: John Snow Labs +name: mt5_summnerizing_russian_10_epochs_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_summnerizing_russian_10_epochs_pipeline` is a English model originally trained by Biakko. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_summnerizing_russian_10_epochs_pipeline_en_5.4.2_3.0_1724386900693.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_summnerizing_russian_10_epochs_pipeline_en_5.4.2_3.0_1724386900693.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_summnerizing_russian_10_epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_summnerizing_russian_10_epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_summnerizing_russian_10_epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/Biakko/mt5_summnerizing_ru_10_epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_thai_reverse_dictionary_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_thai_reverse_dictionary_en.md new file mode 100644 index 00000000000000..845a5a0f19d93f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_thai_reverse_dictionary_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_thai_reverse_dictionary T5Transformer from Nithiwat +author: John Snow Labs +name: mt5_thai_reverse_dictionary +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_thai_reverse_dictionary` is a English model originally trained by Nithiwat. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_thai_reverse_dictionary_en_5.4.2_3.0_1724385254908.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_thai_reverse_dictionary_en_5.4.2_3.0_1724385254908.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_thai_reverse_dictionary","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_thai_reverse_dictionary", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_thai_reverse_dictionary| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/Nithiwat/mt5-thai_reverse_dictionary \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_thai_reverse_dictionary_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_thai_reverse_dictionary_pipeline_en.md new file mode 100644 index 00000000000000..f4719635012a3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_thai_reverse_dictionary_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_thai_reverse_dictionary_pipeline pipeline T5Transformer from Nithiwat +author: John Snow Labs +name: mt5_thai_reverse_dictionary_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_thai_reverse_dictionary_pipeline` is a English model originally trained by Nithiwat. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_thai_reverse_dictionary_pipeline_en_5.4.2_3.0_1724385529536.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_thai_reverse_dictionary_pipeline_en_5.4.2_3.0_1724385529536.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_thai_reverse_dictionary_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_thai_reverse_dictionary_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_thai_reverse_dictionary_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|819.8 MB| + +## References + +https://huggingface.co/Nithiwat/mt5-thai_reverse_dictionary + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_tiny_stories_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_tiny_stories_en.md new file mode 100644 index 00000000000000..f11444db5e2ecb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_tiny_stories_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mt5_tiny_stories T5Transformer from wyh21350 +author: John Snow Labs +name: mt5_tiny_stories +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_tiny_stories` is a English model originally trained by wyh21350. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_tiny_stories_en_5.4.2_3.0_1724388982070.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_tiny_stories_en_5.4.2_3.0_1724388982070.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mt5_tiny_stories","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mt5_tiny_stories", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_tiny_stories| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|276.2 MB| + +## References + +https://huggingface.co/wyh21350/Mt5_tiny_stories \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mt5_tiny_stories_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-mt5_tiny_stories_pipeline_en.md new file mode 100644 index 00000000000000..39cbc7c362e1ee --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mt5_tiny_stories_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English mt5_tiny_stories_pipeline pipeline T5Transformer from wyh21350 +author: John Snow Labs +name: mt5_tiny_stories_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mt5_tiny_stories_pipeline` is a English model originally trained by wyh21350. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mt5_tiny_stories_pipeline_en_5.4.2_3.0_1724389017087.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mt5_tiny_stories_pipeline_en_5.4.2_3.0_1724389017087.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("mt5_tiny_stories_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("mt5_tiny_stories_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mt5_tiny_stories_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|276.2 MB| + +## References + +https://huggingface.co/wyh21350/Mt5_tiny_stories + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-multi_news_train_800_t5_small_summary_model_en.md b/docs/_posts/ahmedlone127/2024-08-23-multi_news_train_800_t5_small_summary_model_en.md new file mode 100644 index 00000000000000..420507b07bed94 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-multi_news_train_800_t5_small_summary_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English multi_news_train_800_t5_small_summary_model T5Transformer from AlexandraSnelling +author: John Snow Labs +name: multi_news_train_800_t5_small_summary_model +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multi_news_train_800_t5_small_summary_model` is a English model originally trained by AlexandraSnelling. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multi_news_train_800_t5_small_summary_model_en_5.4.2_3.0_1724386061136.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multi_news_train_800_t5_small_summary_model_en_5.4.2_3.0_1724386061136.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("multi_news_train_800_t5_small_summary_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("multi_news_train_800_t5_small_summary_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multi_news_train_800_t5_small_summary_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|327.1 MB| + +## References + +https://huggingface.co/AlexandraSnelling/multi_news_train_800_t5-small_summary_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-multi_news_train_800_t5_small_summary_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-multi_news_train_800_t5_small_summary_model_pipeline_en.md new file mode 100644 index 00000000000000..899ec3d280012a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-multi_news_train_800_t5_small_summary_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English multi_news_train_800_t5_small_summary_model_pipeline pipeline T5Transformer from AlexandraSnelling +author: John Snow Labs +name: multi_news_train_800_t5_small_summary_model_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`multi_news_train_800_t5_small_summary_model_pipeline` is a English model originally trained by AlexandraSnelling. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/multi_news_train_800_t5_small_summary_model_pipeline_en_5.4.2_3.0_1724386080978.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/multi_news_train_800_t5_small_summary_model_pipeline_en_5.4.2_3.0_1724386080978.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("multi_news_train_800_t5_small_summary_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("multi_news_train_800_t5_small_summary_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|multi_news_train_800_t5_small_summary_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|327.1 MB| + +## References + +https://huggingface.co/AlexandraSnelling/multi_news_train_800_t5-small_summary_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-mvp_coqe_vit5_en.md b/docs/_posts/ahmedlone127/2024-08-23-mvp_coqe_vit5_en.md new file mode 100644 index 00000000000000..c4ee6742255bce --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-mvp_coqe_vit5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English mvp_coqe_vit5 T5Transformer from ThuyNT03 +author: John Snow Labs +name: mvp_coqe_vit5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`mvp_coqe_vit5` is a English model originally trained by ThuyNT03. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/mvp_coqe_vit5_en_5.4.2_3.0_1724382072226.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/mvp_coqe_vit5_en_5.4.2_3.0_1724382072226.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("mvp_coqe_vit5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("mvp_coqe_vit5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|mvp_coqe_vit5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.0 GB| + +## References + +https://huggingface.co/ThuyNT03/MvP_COQE_viT5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-nmt_english_tonga_tonga_islands_vietnamese_html_en.md b/docs/_posts/ahmedlone127/2024-08-23-nmt_english_tonga_tonga_islands_vietnamese_html_en.md new file mode 100644 index 00000000000000..a78e0bf351fe3f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-nmt_english_tonga_tonga_islands_vietnamese_html_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English nmt_english_tonga_tonga_islands_vietnamese_html T5Transformer from hieunguyen1053 +author: John Snow Labs +name: nmt_english_tonga_tonga_islands_vietnamese_html +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nmt_english_tonga_tonga_islands_vietnamese_html` is a English model originally trained by hieunguyen1053. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nmt_english_tonga_tonga_islands_vietnamese_html_en_5.4.2_3.0_1724398922895.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nmt_english_tonga_tonga_islands_vietnamese_html_en_5.4.2_3.0_1724398922895.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("nmt_english_tonga_tonga_islands_vietnamese_html","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("nmt_english_tonga_tonga_islands_vietnamese_html", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nmt_english_tonga_tonga_islands_vietnamese_html| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|742.1 MB| + +## References + +https://huggingface.co/hieunguyen1053/nmt_en_to_vi_html \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-nmt_english_tonga_tonga_islands_vietnamese_html_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-nmt_english_tonga_tonga_islands_vietnamese_html_pipeline_en.md new file mode 100644 index 00000000000000..cbc845e3c22ce4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-nmt_english_tonga_tonga_islands_vietnamese_html_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English nmt_english_tonga_tonga_islands_vietnamese_html_pipeline pipeline T5Transformer from hieunguyen1053 +author: John Snow Labs +name: nmt_english_tonga_tonga_islands_vietnamese_html_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`nmt_english_tonga_tonga_islands_vietnamese_html_pipeline` is a English model originally trained by hieunguyen1053. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/nmt_english_tonga_tonga_islands_vietnamese_html_pipeline_en_5.4.2_3.0_1724399147878.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/nmt_english_tonga_tonga_islands_vietnamese_html_pipeline_en_5.4.2_3.0_1724399147878.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("nmt_english_tonga_tonga_islands_vietnamese_html_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("nmt_english_tonga_tonga_islands_vietnamese_html_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|nmt_english_tonga_tonga_islands_vietnamese_html_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|742.1 MB| + +## References + +https://huggingface.co/hieunguyen1053/nmt_en_to_vi_html + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_normal_graphs_without_edge_document_level_t5_run3_en.md b/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_normal_graphs_without_edge_document_level_t5_run3_en.md new file mode 100644 index 00000000000000..2f07a3a7d428af --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_normal_graphs_without_edge_document_level_t5_run3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English normal_nodes_normal_graphs_without_edge_document_level_t5_run3 T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_normal_graphs_without_edge_document_level_t5_run3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_normal_graphs_without_edge_document_level_t5_run3` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_normal_graphs_without_edge_document_level_t5_run3_en_5.4.2_3.0_1724378513893.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_normal_graphs_without_edge_document_level_t5_run3_en_5.4.2_3.0_1724378513893.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("normal_nodes_normal_graphs_without_edge_document_level_t5_run3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("normal_nodes_normal_graphs_without_edge_document_level_t5_run3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_normal_graphs_without_edge_document_level_t5_run3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|314.1 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_normal_graphs_without_edge_document_level_T5_run3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline_en.md new file mode 100644 index 00000000000000..dbdee3a1ba670c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724378532300.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline_en_5.4.2_3.0_1724378532300.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|normal_nodes_normal_graphs_without_edge_document_level_t5_run3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|314.1 MB| + +## References + +https://huggingface.co/sheoran95/normal_nodes_normal_graphs_without_edge_document_level_T5_run3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-opinerium_en.md b/docs/_posts/ahmedlone127/2024-08-23-opinerium_en.md new file mode 100644 index 00000000000000..5a69072a93e4c5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-opinerium_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English opinerium T5Transformer from Pedrambbk +author: John Snow Labs +name: opinerium +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`opinerium` is a English model originally trained by Pedrambbk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/opinerium_en_5.4.2_3.0_1724374854955.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/opinerium_en_5.4.2_3.0_1724374854955.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("opinerium","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("opinerium", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|opinerium| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Pedrambbk/Opinerium \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-opinerium_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-opinerium_pipeline_en.md new file mode 100644 index 00000000000000..71be9a26a75049 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-opinerium_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English opinerium_pipeline pipeline T5Transformer from Pedrambbk +author: John Snow Labs +name: opinerium_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`opinerium_pipeline` is a English model originally trained by Pedrambbk. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/opinerium_pipeline_en_5.4.2_3.0_1724375008249.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/opinerium_pipeline_en_5.4.2_3.0_1724375008249.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("opinerium_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("opinerium_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|opinerium_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/Pedrambbk/Opinerium + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-pruned_mt5_small_unfinetuned_en.md b/docs/_posts/ahmedlone127/2024-08-23-pruned_mt5_small_unfinetuned_en.md new file mode 100644 index 00000000000000..8f913a0b81018a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-pruned_mt5_small_unfinetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English pruned_mt5_small_unfinetuned T5Transformer from X-Wang +author: John Snow Labs +name: pruned_mt5_small_unfinetuned +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pruned_mt5_small_unfinetuned` is a English model originally trained by X-Wang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pruned_mt5_small_unfinetuned_en_5.4.2_3.0_1724372171799.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pruned_mt5_small_unfinetuned_en_5.4.2_3.0_1724372171799.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("pruned_mt5_small_unfinetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("pruned_mt5_small_unfinetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pruned_mt5_small_unfinetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|203.5 MB| + +## References + +https://huggingface.co/X-Wang/pruned_mt5_small_unfinetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-pruned_mt5_small_unfinetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-pruned_mt5_small_unfinetuned_pipeline_en.md new file mode 100644 index 00000000000000..d2a77179817ba1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-pruned_mt5_small_unfinetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English pruned_mt5_small_unfinetuned_pipeline pipeline T5Transformer from X-Wang +author: John Snow Labs +name: pruned_mt5_small_unfinetuned_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`pruned_mt5_small_unfinetuned_pipeline` is a English model originally trained by X-Wang. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/pruned_mt5_small_unfinetuned_pipeline_en_5.4.2_3.0_1724372241022.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/pruned_mt5_small_unfinetuned_pipeline_en_5.4.2_3.0_1724372241022.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("pruned_mt5_small_unfinetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("pruned_mt5_small_unfinetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|pruned_mt5_small_unfinetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|203.5 MB| + +## References + +https://huggingface.co/X-Wang/pruned_mt5_small_unfinetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-qgen_vit5_en.md b/docs/_posts/ahmedlone127/2024-08-23-qgen_vit5_en.md new file mode 100644 index 00000000000000..af4b2a59a0c86e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-qgen_vit5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English qgen_vit5 T5Transformer from ambivalent02 +author: John Snow Labs +name: qgen_vit5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qgen_vit5` is a English model originally trained by ambivalent02. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qgen_vit5_en_5.4.2_3.0_1724375636067.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qgen_vit5_en_5.4.2_3.0_1724375636067.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("qgen_vit5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("qgen_vit5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qgen_vit5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ambivalent02/qgen-vit5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-qgen_vit5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-qgen_vit5_pipeline_en.md new file mode 100644 index 00000000000000..ad7298a139a8c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-qgen_vit5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English qgen_vit5_pipeline pipeline T5Transformer from ambivalent02 +author: John Snow Labs +name: qgen_vit5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`qgen_vit5_pipeline` is a English model originally trained by ambivalent02. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/qgen_vit5_pipeline_en_5.4.2_3.0_1724375686669.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/qgen_vit5_pipeline_en_5.4.2_3.0_1724375686669.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("qgen_vit5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("qgen_vit5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|qgen_vit5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ambivalent02/qgen-vit5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-quizbot_ai_small_en.md b/docs/_posts/ahmedlone127/2024-08-23-quizbot_ai_small_en.md new file mode 100644 index 00000000000000..73972251e6c98a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-quizbot_ai_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English quizbot_ai_small T5Transformer from Sujithanumala +author: John Snow Labs +name: quizbot_ai_small +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`quizbot_ai_small` is a English model originally trained by Sujithanumala. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/quizbot_ai_small_en_5.4.2_3.0_1724374191019.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/quizbot_ai_small_en_5.4.2_3.0_1724374191019.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("quizbot_ai_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("quizbot_ai_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|quizbot_ai_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|346.2 MB| + +## References + +https://huggingface.co/Sujithanumala/QuizBot.AI-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-quizbot_ai_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-quizbot_ai_small_pipeline_en.md new file mode 100644 index 00000000000000..06a503f7c669b8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-quizbot_ai_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English quizbot_ai_small_pipeline pipeline T5Transformer from Sujithanumala +author: John Snow Labs +name: quizbot_ai_small_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`quizbot_ai_small_pipeline` is a English model originally trained by Sujithanumala. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/quizbot_ai_small_pipeline_en_5.4.2_3.0_1724374209197.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/quizbot_ai_small_pipeline_en_5.4.2_3.0_1724374209197.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("quizbot_ai_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("quizbot_ai_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|quizbot_ai_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|346.2 MB| + +## References + +https://huggingface.co/Sujithanumala/QuizBot.AI-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-reddit_t5_small_v1_en.md b/docs/_posts/ahmedlone127/2024-08-23-reddit_t5_small_v1_en.md new file mode 100644 index 00000000000000..41cb308d899bdd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-reddit_t5_small_v1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English reddit_t5_small_v1 T5Transformer from doc2query +author: John Snow Labs +name: reddit_t5_small_v1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`reddit_t5_small_v1` is a English model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/reddit_t5_small_v1_en_5.4.2_3.0_1724391880213.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/reddit_t5_small_v1_en_5.4.2_3.0_1724391880213.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("reddit_t5_small_v1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("reddit_t5_small_v1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|reddit_t5_small_v1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/doc2query/reddit-t5-small-v1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-reddit_t5_small_v1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-reddit_t5_small_v1_pipeline_en.md new file mode 100644 index 00000000000000..ec347810b93909 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-reddit_t5_small_v1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English reddit_t5_small_v1_pipeline pipeline T5Transformer from doc2query +author: John Snow Labs +name: reddit_t5_small_v1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`reddit_t5_small_v1_pipeline` is a English model originally trained by doc2query. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/reddit_t5_small_v1_pipeline_en_5.4.2_3.0_1724391896317.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/reddit_t5_small_v1_pipeline_en_5.4.2_3.0_1724391896317.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("reddit_t5_small_v1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("reddit_t5_small_v1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|reddit_t5_small_v1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.7 MB| + +## References + +https://huggingface.co/doc2query/reddit-t5-small-v1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-result_tr1029_en.md b/docs/_posts/ahmedlone127/2024-08-23-result_tr1029_en.md new file mode 100644 index 00000000000000..ae36bf7709544b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-result_tr1029_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English result_tr1029 T5Transformer from Tr1029 +author: John Snow Labs +name: result_tr1029 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`result_tr1029` is a English model originally trained by Tr1029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/result_tr1029_en_5.4.2_3.0_1724392678189.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/result_tr1029_en_5.4.2_3.0_1724392678189.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("result_tr1029","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("result_tr1029", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|result_tr1029| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/Tr1029/result \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-result_tr1029_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-result_tr1029_pipeline_en.md new file mode 100644 index 00000000000000..9966e3a8f6af31 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-result_tr1029_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English result_tr1029_pipeline pipeline T5Transformer from Tr1029 +author: John Snow Labs +name: result_tr1029_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`result_tr1029_pipeline` is a English model originally trained by Tr1029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/result_tr1029_pipeline_en_5.4.2_3.0_1724392695395.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/result_tr1029_pipeline_en_5.4.2_3.0_1724392695395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("result_tr1029_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("result_tr1029_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|result_tr1029_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.0 MB| + +## References + +https://huggingface.co/Tr1029/result + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-resume6_en.md b/docs/_posts/ahmedlone127/2024-08-23-resume6_en.md new file mode 100644 index 00000000000000..2204569d244d84 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-resume6_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English resume6 T5Transformer from AKbuyer +author: John Snow Labs +name: resume6 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`resume6` is a English model originally trained by AKbuyer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/resume6_en_5.4.2_3.0_1724387519447.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/resume6_en_5.4.2_3.0_1724387519447.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("resume6","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("resume6", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|resume6| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|308.5 MB| + +## References + +https://huggingface.co/AKbuyer/resume6 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-resume6_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-resume6_pipeline_en.md new file mode 100644 index 00000000000000..48323564be1782 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-resume6_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English resume6_pipeline pipeline T5Transformer from AKbuyer +author: John Snow Labs +name: resume6_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`resume6_pipeline` is a English model originally trained by AKbuyer. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/resume6_pipeline_en_5.4.2_3.0_1724387544737.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/resume6_pipeline_en_5.4.2_3.0_1724387544737.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("resume6_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("resume6_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|resume6_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|308.5 MB| + +## References + +https://huggingface.co/AKbuyer/resume6 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-russian_mt5_en.md b/docs/_posts/ahmedlone127/2024-08-23-russian_mt5_en.md new file mode 100644 index 00000000000000..6c76a7bf2d8ebc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-russian_mt5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English russian_mt5 T5Transformer from andrey200702 +author: John Snow Labs +name: russian_mt5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`russian_mt5` is a English model originally trained by andrey200702. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/russian_mt5_en_5.4.2_3.0_1724371378738.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/russian_mt5_en_5.4.2_3.0_1724371378738.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("russian_mt5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("russian_mt5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|russian_mt5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/andrey200702/ru_mt5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rut5_base_finetuned_plenka_chatbot_full_en.md b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_finetuned_plenka_chatbot_full_en.md new file mode 100644 index 00000000000000..42111170b9f702 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_finetuned_plenka_chatbot_full_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_finetuned_plenka_chatbot_full T5Transformer from valeriazen +author: John Snow Labs +name: rut5_base_finetuned_plenka_chatbot_full +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_finetuned_plenka_chatbot_full` is a English model originally trained by valeriazen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_finetuned_plenka_chatbot_full_en_5.4.2_3.0_1724376466863.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_finetuned_plenka_chatbot_full_en_5.4.2_3.0_1724376466863.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_finetuned_plenka_chatbot_full","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_finetuned_plenka_chatbot_full", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_finetuned_plenka_chatbot_full| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/valeriazen/ruT5-base-finetuned-plenka-chatbot-full \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rut5_base_finetuned_plenka_chatbot_full_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_finetuned_plenka_chatbot_full_pipeline_en.md new file mode 100644 index 00000000000000..ff2f2a77003b35 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_finetuned_plenka_chatbot_full_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_finetuned_plenka_chatbot_full_pipeline pipeline T5Transformer from valeriazen +author: John Snow Labs +name: rut5_base_finetuned_plenka_chatbot_full_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_finetuned_plenka_chatbot_full_pipeline` is a English model originally trained by valeriazen. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_finetuned_plenka_chatbot_full_pipeline_en_5.4.2_3.0_1724376514697.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_finetuned_plenka_chatbot_full_pipeline_en_5.4.2_3.0_1724376514697.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_finetuned_plenka_chatbot_full_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_finetuned_plenka_chatbot_full_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_finetuned_plenka_chatbot_full_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/valeriazen/ruT5-base-finetuned-plenka-chatbot-full + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rut5_base_summ_dialogsum_en.md b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_summ_dialogsum_en.md new file mode 100644 index 00000000000000..eaace61b44e066 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_summ_dialogsum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English rut5_base_summ_dialogsum T5Transformer from Kekega +author: John Snow Labs +name: rut5_base_summ_dialogsum +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_summ_dialogsum` is a English model originally trained by Kekega. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_summ_dialogsum_en_5.4.2_3.0_1724386385294.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_summ_dialogsum_en_5.4.2_3.0_1724386385294.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("rut5_base_summ_dialogsum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("rut5_base_summ_dialogsum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_summ_dialogsum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Kekega/rut5-base-summ-dialogsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-rut5_base_summ_dialogsum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_summ_dialogsum_pipeline_en.md new file mode 100644 index 00000000000000..23d1a949b50b2e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-rut5_base_summ_dialogsum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English rut5_base_summ_dialogsum_pipeline pipeline T5Transformer from Kekega +author: John Snow Labs +name: rut5_base_summ_dialogsum_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`rut5_base_summ_dialogsum_pipeline` is a English model originally trained by Kekega. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/rut5_base_summ_dialogsum_pipeline_en_5.4.2_3.0_1724386440055.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/rut5_base_summ_dialogsum_pipeline_en_5.4.2_3.0_1724386440055.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("rut5_base_summ_dialogsum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("rut5_base_summ_dialogsum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|rut5_base_summ_dialogsum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Kekega/rut5-base-summ-dialogsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-scores_flan_t5_large_22_11_en.md b/docs/_posts/ahmedlone127/2024-08-23-scores_flan_t5_large_22_11_en.md new file mode 100644 index 00000000000000..60d68590473977 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-scores_flan_t5_large_22_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English scores_flan_t5_large_22_11 T5Transformer from oscorrea +author: John Snow Labs +name: scores_flan_t5_large_22_11 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scores_flan_t5_large_22_11` is a English model originally trained by oscorrea. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scores_flan_t5_large_22_11_en_5.4.2_3.0_1724392332951.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scores_flan_t5_large_22_11_en_5.4.2_3.0_1724392332951.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("scores_flan_t5_large_22_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("scores_flan_t5_large_22_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scores_flan_t5_large_22_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/oscorrea/scores-flan-t5-large-22-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-scores_flan_t5_large_22_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-scores_flan_t5_large_22_11_pipeline_en.md new file mode 100644 index 00000000000000..ed95e7f5dae4b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-scores_flan_t5_large_22_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English scores_flan_t5_large_22_11_pipeline pipeline T5Transformer from oscorrea +author: John Snow Labs +name: scores_flan_t5_large_22_11_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`scores_flan_t5_large_22_11_pipeline` is a English model originally trained by oscorrea. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/scores_flan_t5_large_22_11_pipeline_en_5.4.2_3.0_1724392469553.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/scores_flan_t5_large_22_11_pipeline_en_5.4.2_3.0_1724392469553.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("scores_flan_t5_large_22_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("scores_flan_t5_large_22_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|scores_flan_t5_large_22_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/oscorrea/scores-flan-t5-large-22-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-setup_2c_en.md b/docs/_posts/ahmedlone127/2024-08-23-setup_2c_en.md new file mode 100644 index 00000000000000..57116a03163ab7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-setup_2c_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English setup_2c T5Transformer from Lakshya388 +author: John Snow Labs +name: setup_2c +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`setup_2c` is a English model originally trained by Lakshya388. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/setup_2c_en_5.4.2_3.0_1724396288270.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/setup_2c_en_5.4.2_3.0_1724396288270.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("setup_2c","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("setup_2c", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|setup_2c| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.3 MB| + +## References + +https://huggingface.co/Lakshya388/setup_2C \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-setup_2c_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-setup_2c_pipeline_en.md new file mode 100644 index 00000000000000..873cc264f9b334 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-setup_2c_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English setup_2c_pipeline pipeline T5Transformer from Lakshya388 +author: John Snow Labs +name: setup_2c_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`setup_2c_pipeline` is a English model originally trained by Lakshya388. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/setup_2c_pipeline_en_5.4.2_3.0_1724396305677.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/setup_2c_pipeline_en_5.4.2_3.0_1724396305677.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("setup_2c_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("setup_2c_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|setup_2c_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.3 MB| + +## References + +https://huggingface.co/Lakshya388/setup_2C + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-single_sentence_models_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-single_sentence_models_1_en.md new file mode 100644 index 00000000000000..f399b67712bd8a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-single_sentence_models_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English single_sentence_models_1 T5Transformer from sheoran95 +author: John Snow Labs +name: single_sentence_models_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`single_sentence_models_1` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/single_sentence_models_1_en_5.4.2_3.0_1724402446259.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/single_sentence_models_1_en_5.4.2_3.0_1724402446259.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("single_sentence_models_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("single_sentence_models_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|single_sentence_models_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|326.0 MB| + +## References + +https://huggingface.co/sheoran95/single_sentence_models_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-single_sentence_models_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-single_sentence_models_1_pipeline_en.md new file mode 100644 index 00000000000000..b076298b53e41b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-single_sentence_models_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English single_sentence_models_1_pipeline pipeline T5Transformer from sheoran95 +author: John Snow Labs +name: single_sentence_models_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`single_sentence_models_1_pipeline` is a English model originally trained by sheoran95. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/single_sentence_models_1_pipeline_en_5.4.2_3.0_1724402464554.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/single_sentence_models_1_pipeline_en_5.4.2_3.0_1724402464554.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("single_sentence_models_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("single_sentence_models_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|single_sentence_models_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|326.0 MB| + +## References + +https://huggingface.co/sheoran95/single_sentence_models_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-sno_extend_2500_en.md b/docs/_posts/ahmedlone127/2024-08-23-sno_extend_2500_en.md new file mode 100644 index 00000000000000..91f71033827e9e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-sno_extend_2500_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English sno_extend_2500 T5Transformer from Roy029 +author: John Snow Labs +name: sno_extend_2500 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sno_extend_2500` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sno_extend_2500_en_5.4.2_3.0_1724398746669.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sno_extend_2500_en_5.4.2_3.0_1724398746669.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("sno_extend_2500","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("sno_extend_2500", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sno_extend_2500| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|543.7 MB| + +## References + +https://huggingface.co/Roy029/sno_extend_2500 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-sno_extend_2500_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-sno_extend_2500_pipeline_en.md new file mode 100644 index 00000000000000..2fe87b076c3ecf --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-sno_extend_2500_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English sno_extend_2500_pipeline pipeline T5Transformer from Roy029 +author: John Snow Labs +name: sno_extend_2500_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`sno_extend_2500_pipeline` is a English model originally trained by Roy029. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/sno_extend_2500_pipeline_en_5.4.2_3.0_1724398925009.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/sno_extend_2500_pipeline_en_5.4.2_3.0_1724398925009.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("sno_extend_2500_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("sno_extend_2500_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|sno_extend_2500_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|543.7 MB| + +## References + +https://huggingface.co/Roy029/sno_extend_2500 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-summarization_model_mraj2288_en.md b/docs/_posts/ahmedlone127/2024-08-23-summarization_model_mraj2288_en.md new file mode 100644 index 00000000000000..0f2de8e645c82e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-summarization_model_mraj2288_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarization_model_mraj2288 T5Transformer from mraj2288 +author: John Snow Labs +name: summarization_model_mraj2288 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_model_mraj2288` is a English model originally trained by mraj2288. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_model_mraj2288_en_5.4.2_3.0_1724382397108.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_model_mraj2288_en_5.4.2_3.0_1724382397108.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarization_model_mraj2288","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarization_model_mraj2288", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_model_mraj2288| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/mraj2288/summarization_model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-summarization_model_mraj2288_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-summarization_model_mraj2288_pipeline_en.md new file mode 100644 index 00000000000000..5dfe42d2bae13c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-summarization_model_mraj2288_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarization_model_mraj2288_pipeline pipeline T5Transformer from mraj2288 +author: John Snow Labs +name: summarization_model_mraj2288_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_model_mraj2288_pipeline` is a English model originally trained by mraj2288. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_model_mraj2288_pipeline_en_5.4.2_3.0_1724382416077.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_model_mraj2288_pipeline_en_5.4.2_3.0_1724382416077.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarization_model_mraj2288_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarization_model_mraj2288_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_model_mraj2288_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.1 MB| + +## References + +https://huggingface.co/mraj2288/summarization_model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-summarization_tfm_claudia_en.md b/docs/_posts/ahmedlone127/2024-08-23-summarization_tfm_claudia_en.md new file mode 100644 index 00000000000000..152cd78e6052db --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-summarization_tfm_claudia_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English summarization_tfm_claudia T5Transformer from clxudiajazmin +author: John Snow Labs +name: summarization_tfm_claudia +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_tfm_claudia` is a English model originally trained by clxudiajazmin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_tfm_claudia_en_5.4.2_3.0_1724397232376.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_tfm_claudia_en_5.4.2_3.0_1724397232376.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("summarization_tfm_claudia","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("summarization_tfm_claudia", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_tfm_claudia| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|332.1 MB| + +## References + +https://huggingface.co/clxudiajazmin/summarization-TFM-Claudia \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-summarization_tfm_claudia_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-summarization_tfm_claudia_pipeline_en.md new file mode 100644 index 00000000000000..6e4328d85256e2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-summarization_tfm_claudia_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English summarization_tfm_claudia_pipeline pipeline T5Transformer from clxudiajazmin +author: John Snow Labs +name: summarization_tfm_claudia_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`summarization_tfm_claudia_pipeline` is a English model originally trained by clxudiajazmin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/summarization_tfm_claudia_pipeline_en_5.4.2_3.0_1724397252097.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/summarization_tfm_claudia_pipeline_en_5.4.2_3.0_1724397252097.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("summarization_tfm_claudia_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("summarization_tfm_claudia_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|summarization_tfm_claudia_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|332.1 MB| + +## References + +https://huggingface.co/clxudiajazmin/summarization-TFM-Claudia + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_combined_years_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_combined_years_en.md new file mode 100644 index 00000000000000..c80a37c4432876 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_combined_years_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_aic_combined_years T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_aic_combined_years +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_aic_combined_years` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_aic_combined_years_en_5.4.2_3.0_1724384996018.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_aic_combined_years_en_5.4.2_3.0_1724384996018.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_aic_combined_years","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_aic_combined_years", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_aic_combined_years| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|321.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-aic-combined_years \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_combined_years_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_combined_years_pipeline_en.md new file mode 100644 index 00000000000000..09613ff6f366cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_aic_combined_years_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_aic_combined_years_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_aic_combined_years_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_aic_combined_years_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_aic_combined_years_pipeline_en_5.4.2_3.0_1724385019475.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_aic_combined_years_pipeline_en_5.4.2_3.0_1724385019475.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_aic_combined_years_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_aic_combined_years_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_aic_combined_years_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|321.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-aic-combined_years + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_11_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_11_en.md new file mode 100644 index 00000000000000..f6bb00bc31ee19 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_11 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_11 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_11` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_11_en_5.4.2_3.0_1724397698099.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_11_en_5.4.2_3.0_1724397698099.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2012_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_11_pipeline_en.md new file mode 100644 index 00000000000000..d869417d44677e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2012_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2012_11_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2012_11_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2012_11_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_11_pipeline_en_5.4.2_3.0_1724397715205.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2012_11_pipeline_en_5.4.2_3.0_1724397715205.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2012_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2012_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2012_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2012-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_7_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_7_en.md new file mode 100644 index 00000000000000..36d6aa0f0c5f02 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_7_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_7 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_7 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_7` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_7_en_5.4.2_3.0_1724387161516.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_7_en_5.4.2_3.0_1724387161516.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_7","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2015_7", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_7| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-7 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_7_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_7_pipeline_en.md new file mode 100644 index 00000000000000..9bf30fbd1966f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2015_7_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2015_7_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2015_7_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2015_7_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_7_pipeline_en_5.4.2_3.0_1724387177975.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2015_7_pipeline_en_5.4.2_3.0_1724387177975.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2015_7_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2015_7_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2015_7_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2015-7 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2016_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2016_1_en.md new file mode 100644 index 00000000000000..38f288fc331216 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2016_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_1 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_1` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_1_en_5.4.2_3.0_1724376623985.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_1_en_5.4.2_3.0_1724376623985.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2016_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2016_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2016_1_pipeline_en.md new file mode 100644 index 00000000000000..65f5b6cdc9384c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2016_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2016_1_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2016_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2016_1_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_1_pipeline_en_5.4.2_3.0_1724376640509.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2016_1_pipeline_en_5.4.2_3.0_1724376640509.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2016_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2016_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2016_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.2 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2016-1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2017_11_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2017_11_en.md new file mode 100644 index 00000000000000..00aa7955d18d73 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2017_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_11 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_11 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_11` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_11_en_5.4.2_3.0_1724397475059.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_11_en_5.4.2_3.0_1724397475059.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2017_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2017_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2017_11_pipeline_en.md new file mode 100644 index 00000000000000..ed4b00f93a2dc6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2017_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2017_11_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2017_11_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2017_11_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_11_pipeline_en_5.4.2_3.0_1724397491660.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2017_11_pipeline_en_5.4.2_3.0_1724397491660.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2017_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2017_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2017_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2017-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_11_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_11_en.md new file mode 100644 index 00000000000000..4429fb2208dd36 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_11_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_11 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_11 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_11` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_11_en_5.4.2_3.0_1724382799172.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_11_en_5.4.2_3.0_1724382799172.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_11","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2020_11", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_11| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-11 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_11_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_11_pipeline_en.md new file mode 100644 index 00000000000000..75b0584f97400c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2020_11_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2020_11_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2020_11_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2020_11_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_11_pipeline_en_5.4.2_3.0_1724382815866.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2020_11_pipeline_en_5.4.2_3.0_1724382815866.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2020_11_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2020_11_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2020_11_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2020-11 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2021_5_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2021_5_en.md new file mode 100644 index 00000000000000..4d8e7f404f9760 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2021_5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_5 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_5` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_5_en_5.4.2_3.0_1724404039167.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_5_en_5.4.2_3.0_1724404039167.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_lm_wmt_2021_5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2021_5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2021_5_pipeline_en.md new file mode 100644 index 00000000000000..68fd9d499296ae --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_lm_wmt_2021_5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_lm_wmt_2021_5_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_lm_wmt_2021_5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_lm_wmt_2021_5_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_5_pipeline_en_5.4.2_3.0_1724404055846.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_lm_wmt_2021_5_pipeline_en_5.4.2_3.0_1724404055846.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_lm_wmt_2021_5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_lm_wmt_2021_5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_lm_wmt_2021_5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.1 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-lm-wmt-2021-5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_2_en.md new file mode 100644 index 00000000000000..3edbade8c1f875 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_2 T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_2` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_2_en_5.4.2_3.0_1724392580268.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_2_en_5.4.2_3.0_1724392580268.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_60m_poli_aff_2020_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|300.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_2_pipeline_en.md new file mode 100644 index 00000000000000..9393b1528eeef8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_60m_poli_aff_2020_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_60m_poli_aff_2020_2_pipeline pipeline T5Transformer from KaiNylund +author: John Snow Labs +name: t5_60m_poli_aff_2020_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_60m_poli_aff_2020_2_pipeline` is a English model originally trained by KaiNylund. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_2_pipeline_en_5.4.2_3.0_1724392608809.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_60m_poli_aff_2020_2_pipeline_en_5.4.2_3.0_1724392608809.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_60m_poli_aff_2020_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_60m_poli_aff_2020_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_60m_poli_aff_2020_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|300.0 MB| + +## References + +https://huggingface.co/KaiNylund/t5-60M-poli_aff-2020-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_abwqr_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_abwqr_en.md new file mode 100644 index 00000000000000..a9a760e6b00ea8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_abwqr_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_abwqr T5Transformer from abwqr +author: John Snow Labs +name: t5_abwqr +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_abwqr` is a English model originally trained by abwqr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_abwqr_en_5.4.2_3.0_1724402492674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_abwqr_en_5.4.2_3.0_1724402492674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_abwqr","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_abwqr", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_abwqr| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|102.7 MB| + +## References + +https://huggingface.co/abwqr/t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_abwqr_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_abwqr_pipeline_en.md new file mode 100644 index 00000000000000..f5ad7ebcd6e2b6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_abwqr_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_abwqr_pipeline pipeline T5Transformer from abwqr +author: John Snow Labs +name: t5_abwqr_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_abwqr_pipeline` is a English model originally trained by abwqr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_abwqr_pipeline_en_5.4.2_3.0_1724402498415.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_abwqr_pipeline_en_5.4.2_3.0_1724402498415.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_abwqr_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_abwqr_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_abwqr_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|102.7 MB| + +## References + +https://huggingface.co/abwqr/t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_dense2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_dense2_en.md new file mode 100644 index 00000000000000..abffdd30a58743 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_dense2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_dense2 T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_dense2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dense2` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dense2_en_5.4.2_3.0_1724395901165.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dense2_en_5.4.2_3.0_1724395901165.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_dense2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_dense2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dense2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_dense2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_dense2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_dense2_pipeline_en.md new file mode 100644 index 00000000000000..de46281032c0b0 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_dense2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_dense2_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_dense2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_dense2_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_dense2_pipeline_en_5.4.2_3.0_1724396046618.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_dense2_pipeline_en_5.4.2_3.0_1724396046618.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_dense2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_dense2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_dense2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_dense2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_ner_docred_30_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_ner_docred_30_en.md new file mode 100644 index 00000000000000..db70ea59a6b81b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_ner_docred_30_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_ner_docred_30 T5Transformer from zblaaa +author: John Snow Labs +name: t5_base_finetuned_ner_docred_30 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_ner_docred_30` is a English model originally trained by zblaaa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_ner_docred_30_en_5.4.2_3.0_1724378977275.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_ner_docred_30_en_5.4.2_3.0_1724378977275.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_ner_docred_30","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_ner_docred_30", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_ner_docred_30| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|980.4 MB| + +## References + +https://huggingface.co/zblaaa/t5-base-finetuned-ner_docred_30 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_ner_docred_30_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_ner_docred_30_pipeline_en.md new file mode 100644 index 00000000000000..d27566843b3134 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_ner_docred_30_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_ner_docred_30_pipeline pipeline T5Transformer from zblaaa +author: John Snow Labs +name: t5_base_finetuned_ner_docred_30_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_ner_docred_30_pipeline` is a English model originally trained by zblaaa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_ner_docred_30_pipeline_en_5.4.2_3.0_1724379026010.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_ner_docred_30_pipeline_en_5.4.2_3.0_1724379026010.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_ner_docred_30_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_ner_docred_30_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_ner_docred_30_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|980.4 MB| + +## References + +https://huggingface.co/zblaaa/t5-base-finetuned-ner_docred_30 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_scitldr_try1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_scitldr_try1_en.md new file mode 100644 index 00000000000000..fcc8011e28c154 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_scitldr_try1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_finetuned_scitldr_try1 T5Transformer from witchling22 +author: John Snow Labs +name: t5_base_finetuned_scitldr_try1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_scitldr_try1` is a English model originally trained by witchling22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_scitldr_try1_en_5.4.2_3.0_1724383436803.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_scitldr_try1_en_5.4.2_3.0_1724383436803.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_finetuned_scitldr_try1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_finetuned_scitldr_try1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_scitldr_try1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|880.9 MB| + +## References + +https://huggingface.co/witchling22/t5-base-finetuned-scitldr_try1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_scitldr_try1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_scitldr_try1_pipeline_en.md new file mode 100644 index 00000000000000..808f875d327164 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_finetuned_scitldr_try1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_finetuned_scitldr_try1_pipeline pipeline T5Transformer from witchling22 +author: John Snow Labs +name: t5_base_finetuned_scitldr_try1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_finetuned_scitldr_try1_pipeline` is a English model originally trained by witchling22. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_scitldr_try1_pipeline_en_5.4.2_3.0_1724383517869.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_finetuned_scitldr_try1_pipeline_en_5.4.2_3.0_1724383517869.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_finetuned_scitldr_try1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_finetuned_scitldr_try1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_finetuned_scitldr_try1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|880.9 MB| + +## References + +https://huggingface.co/witchling22/t5-base-finetuned-scitldr_try1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_long_qkquiz_qag2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_long_qkquiz_qag2_en.md new file mode 100644 index 00000000000000..acd0a2b5582cc2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_long_qkquiz_qag2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_long_qkquiz_qag2 T5Transformer from ymorioka +author: John Snow Labs +name: t5_base_long_qkquiz_qag2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_qkquiz_qag2` is a English model originally trained by ymorioka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_qkquiz_qag2_en_5.4.2_3.0_1724404504488.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_qkquiz_qag2_en_5.4.2_3.0_1724404504488.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_long_qkquiz_qag2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_long_qkquiz_qag2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_qkquiz_qag2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ymorioka/t5-base-long-qkquiz-qag2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_long_qkquiz_qag2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_long_qkquiz_qag2_pipeline_en.md new file mode 100644 index 00000000000000..8363d523d64d57 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_long_qkquiz_qag2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_long_qkquiz_qag2_pipeline pipeline T5Transformer from ymorioka +author: John Snow Labs +name: t5_base_long_qkquiz_qag2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_long_qkquiz_qag2_pipeline` is a English model originally trained by ymorioka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_long_qkquiz_qag2_pipeline_en_5.4.2_3.0_1724404551517.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_long_qkquiz_qag2_pipeline_en_5.4.2_3.0_1724404551517.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_long_qkquiz_qag2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_long_qkquiz_qag2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_long_qkquiz_qag2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/ymorioka/t5-base-long-qkquiz-qag2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_mare_ar1_ex15_half_from_ft_scaler_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_mare_ar1_ex15_half_from_ft_scaler_en.md new file mode 100644 index 00000000000000..2a2d6dfe22449b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_mare_ar1_ex15_half_from_ft_scaler_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_mare_ar1_ex15_half_from_ft_scaler T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_mare_ar1_ex15_half_from_ft_scaler +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_mare_ar1_ex15_half_from_ft_scaler` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_mare_ar1_ex15_half_from_ft_scaler_en_5.4.2_3.0_1724384168715.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_mare_ar1_ex15_half_from_ft_scaler_en_5.4.2_3.0_1724384168715.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_mare_ar1_ex15_half_from_ft_scaler","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_mare_ar1_ex15_half_from_ft_scaler", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_mare_ar1_ex15_half_from_ft_scaler| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_mare_ar1_ex15_half_from_ft_scaler \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline_en.md new file mode 100644 index 00000000000000..6d3c89a454b312 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline pipeline T5Transformer from lukeleeai +author: John Snow Labs +name: t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline` is a English model originally trained by lukeleeai. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline_en_5.4.2_3.0_1724384319587.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline_en_5.4.2_3.0_1724384319587.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|624.5 MB| + +## References + +https://huggingface.co/lukeleeai/t5-base_mare_ar1_ex15_half_from_ft_scaler + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_rl_trainset_100percent_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_rl_trainset_100percent_en.md new file mode 100644 index 00000000000000..3115165e06ae06 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_rl_trainset_100percent_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_rl_trainset_100percent T5Transformer from Nikhil20b +author: John Snow Labs +name: t5_base_rl_trainset_100percent +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rl_trainset_100percent` is a English model originally trained by Nikhil20b. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rl_trainset_100percent_en_5.4.2_3.0_1724371275759.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rl_trainset_100percent_en_5.4.2_3.0_1724371275759.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_rl_trainset_100percent","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_rl_trainset_100percent", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rl_trainset_100percent| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Nikhil20b/T5_base_RL_trainset_100percent \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_rl_trainset_100percent_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_rl_trainset_100percent_pipeline_en.md new file mode 100644 index 00000000000000..077663fdb9aaa8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_rl_trainset_100percent_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_rl_trainset_100percent_pipeline pipeline T5Transformer from Nikhil20b +author: John Snow Labs +name: t5_base_rl_trainset_100percent_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_rl_trainset_100percent_pipeline` is a English model originally trained by Nikhil20b. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_rl_trainset_100percent_pipeline_en_5.4.2_3.0_1724371324389.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_rl_trainset_100percent_pipeline_en_5.4.2_3.0_1724371324389.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_rl_trainset_100percent_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_rl_trainset_100percent_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_rl_trainset_100percent_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Nikhil20b/T5_base_RL_trainset_100percent + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_spellchecker_suglus_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_spellchecker_suglus_en.md new file mode 100644 index 00000000000000..86b6e0df8e1a21 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_spellchecker_suglus_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_spellchecker_suglus T5Transformer from Suglus +author: John Snow Labs +name: t5_base_spellchecker_suglus +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_spellchecker_suglus` is a English model originally trained by Suglus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_spellchecker_suglus_en_5.4.2_3.0_1724396826581.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_spellchecker_suglus_en_5.4.2_3.0_1724396826581.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_spellchecker_suglus","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_spellchecker_suglus", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_spellchecker_suglus| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Suglus/t5-base-spellchecker \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_spellchecker_suglus_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_spellchecker_suglus_pipeline_en.md new file mode 100644 index 00000000000000..021cc3f8949e90 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_spellchecker_suglus_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_spellchecker_suglus_pipeline pipeline T5Transformer from Suglus +author: John Snow Labs +name: t5_base_spellchecker_suglus_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_spellchecker_suglus_pipeline` is a English model originally trained by Suglus. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_spellchecker_suglus_pipeline_en_5.4.2_3.0_1724396873991.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_spellchecker_suglus_pipeline_en_5.4.2_3.0_1724396873991.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_spellchecker_suglus_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_spellchecker_suglus_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_spellchecker_suglus_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Suglus/t5-base-spellchecker + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_subjqa_vanilla_tripadvisor_qg_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_subjqa_vanilla_tripadvisor_qg_en.md new file mode 100644 index 00000000000000..10d475725c6e08 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_subjqa_vanilla_tripadvisor_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_subjqa_vanilla_tripadvisor_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_vanilla_tripadvisor_qg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_vanilla_tripadvisor_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_tripadvisor_qg_en_5.4.2_3.0_1724398023277.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_tripadvisor_qg_en_5.4.2_3.0_1724398023277.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_subjqa_vanilla_tripadvisor_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_subjqa_vanilla_tripadvisor_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_vanilla_tripadvisor_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|962.4 MB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-vanilla-tripadvisor-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_subjqa_vanilla_tripadvisor_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_subjqa_vanilla_tripadvisor_qg_pipeline_en.md new file mode 100644 index 00000000000000..5f3b4065850570 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_subjqa_vanilla_tripadvisor_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_subjqa_vanilla_tripadvisor_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_base_subjqa_vanilla_tripadvisor_qg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_subjqa_vanilla_tripadvisor_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_tripadvisor_qg_pipeline_en_5.4.2_3.0_1724398080307.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_subjqa_vanilla_tripadvisor_qg_pipeline_en_5.4.2_3.0_1724398080307.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_subjqa_vanilla_tripadvisor_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_subjqa_vanilla_tripadvisor_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_subjqa_vanilla_tripadvisor_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|962.4 MB| + +## References + +https://huggingface.co/research-backup/t5-base-subjqa-vanilla-tripadvisor-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_10rear_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_10rear_en.md new file mode 100644 index 00000000000000..fb396bd788185f --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_10rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_10rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_10rear +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_10rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_10rear_en_5.4.2_3.0_1724379350125.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_10rear_en_5.4.2_3.0_1724379350125.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_10rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_10rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_10rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-10rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_10rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_10rear_pipeline_en.md new file mode 100644 index 00000000000000..d6f5b8b86641f7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_10rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_10rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_10rear_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_10rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_10rear_pipeline_en_5.4.2_3.0_1724379398607.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_10rear_pipeline_en_5.4.2_3.0_1724379398607.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_0front_1body_10rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_0front_1body_10rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_10rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-10rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_3rear_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_3rear_en.md new file mode 100644 index 00000000000000..ec7593a9046a21 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_3rear_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_3rear T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_3rear +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_3rear` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_3rear_en_5.4.2_3.0_1724404388984.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_3rear_en_5.4.2_3.0_1724404388984.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_3rear","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tedxjp_0front_1body_3rear", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_3rear| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-3rear \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_3rear_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_3rear_pipeline_en.md new file mode 100644 index 00000000000000..efcb4357a135cc --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tedxjp_0front_1body_3rear_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tedxjp_0front_1body_3rear_pipeline pipeline T5Transformer from Padomin +author: John Snow Labs +name: t5_base_tedxjp_0front_1body_3rear_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tedxjp_0front_1body_3rear_pipeline` is a English model originally trained by Padomin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_3rear_pipeline_en_5.4.2_3.0_1724404438424.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tedxjp_0front_1body_3rear_pipeline_en_5.4.2_3.0_1724404438424.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tedxjp_0front_1body_3rear_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tedxjp_0front_1body_3rear_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tedxjp_0front_1body_3rear_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Padomin/t5-base-TEDxJP-0front-1body-3rear + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed36_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed36_en.md new file mode 100644 index 00000000000000..48383dcc46f76c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed36_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tweetsumm_seed36 T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsumm_seed36 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsumm_seed36` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed36_en_5.4.2_3.0_1724402534234.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed36_en_5.4.2_3.0_1724402534234.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tweetsumm_seed36","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tweetsumm_seed36", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsumm_seed36| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.5 MB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsumm-seed36 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed36_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed36_pipeline_en.md new file mode 100644 index 00000000000000..d065e87727b8bb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed36_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tweetsumm_seed36_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsumm_seed36_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsumm_seed36_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed36_pipeline_en_5.4.2_3.0_1724402581857.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed36_pipeline_en_5.4.2_3.0_1724402581857.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tweetsumm_seed36_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tweetsumm_seed36_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsumm_seed36_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.5 MB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsumm-seed36 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed42_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed42_en.md new file mode 100644 index 00000000000000..7036afaa542ed1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed42_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_base_tweetsumm_seed42 T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsumm_seed42 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsumm_seed42` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed42_en_5.4.2_3.0_1724374822153.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed42_en_5.4.2_3.0_1724374822153.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_base_tweetsumm_seed42","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_base_tweetsumm_seed42", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsumm_seed42| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|999.5 MB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsumm-seed42 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed42_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed42_pipeline_en.md new file mode 100644 index 00000000000000..76b0286d2bcd10 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_base_tweetsumm_seed42_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_base_tweetsumm_seed42_pipeline pipeline T5Transformer from PSW +author: John Snow Labs +name: t5_base_tweetsumm_seed42_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_base_tweetsumm_seed42_pipeline` is a English model originally trained by PSW. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed42_pipeline_en_5.4.2_3.0_1724374869645.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_base_tweetsumm_seed42_pipeline_en_5.4.2_3.0_1724374869645.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_base_tweetsumm_seed42_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_base_tweetsumm_seed42_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_base_tweetsumm_seed42_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|999.5 MB| + +## References + +https://huggingface.co/PSW/t5-base-tweetsumm-seed42 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_claude_training_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_claude_training_en.md new file mode 100644 index 00000000000000..fc3691a3d62532 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_claude_training_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_claude_training T5Transformer from Leslie123 +author: John Snow Labs +name: t5_claude_training +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_claude_training` is a English model originally trained by Leslie123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_claude_training_en_5.4.2_3.0_1724403214337.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_claude_training_en_5.4.2_3.0_1724403214337.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_claude_training","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_claude_training", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_claude_training| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Leslie123/t5-claude-training \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_claude_training_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_claude_training_pipeline_en.md new file mode 100644 index 00000000000000..4044835af58e9e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_claude_training_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_claude_training_pipeline pipeline T5Transformer from Leslie123 +author: John Snow Labs +name: t5_claude_training_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_claude_training_pipeline` is a English model originally trained by Leslie123. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_claude_training_pipeline_en_5.4.2_3.0_1724403261957.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_claude_training_pipeline_en_5.4.2_3.0_1724403261957.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_claude_training_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_claude_training_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_claude_training_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Leslie123/t5-claude-training + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_f_experiment_3_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_f_experiment_3_en.md new file mode 100644 index 00000000000000..c5bf42ade1e142 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_f_experiment_3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_f_experiment_3 T5Transformer from mllm-dev +author: John Snow Labs +name: t5_f_experiment_3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_f_experiment_3` is a English model originally trained by mllm-dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_f_experiment_3_en_5.4.2_3.0_1724404160853.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_f_experiment_3_en_5.4.2_3.0_1724404160853.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_f_experiment_3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_f_experiment_3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_f_experiment_3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|293.8 MB| + +## References + +https://huggingface.co/mllm-dev/t5_f_experiment_3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_f_experiment_3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_f_experiment_3_pipeline_en.md new file mode 100644 index 00000000000000..160bf2e12eee60 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_f_experiment_3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_f_experiment_3_pipeline pipeline T5Transformer from mllm-dev +author: John Snow Labs +name: t5_f_experiment_3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_f_experiment_3_pipeline` is a English model originally trained by mllm-dev. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_f_experiment_3_pipeline_en_5.4.2_3.0_1724404187559.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_f_experiment_3_pipeline_en_5.4.2_3.0_1724404187559.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_f_experiment_3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_f_experiment_3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_f_experiment_3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|293.8 MB| + +## References + +https://huggingface.co/mllm-dev/t5_f_experiment_3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_hana_summarization_model_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_hana_summarization_model_en.md new file mode 100644 index 00000000000000..f02a1e2ddd4c15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_hana_summarization_model_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_hana_summarization_model T5Transformer from hong213 +author: John Snow Labs +name: t5_hana_summarization_model +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_hana_summarization_model` is a English model originally trained by hong213. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_hana_summarization_model_en_5.4.2_3.0_1724375058874.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_hana_summarization_model_en_5.4.2_3.0_1724375058874.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_hana_summarization_model","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_hana_summarization_model", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_hana_summarization_model| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|318.2 MB| + +## References + +https://huggingface.co/hong213/t5-hana-summarization-model \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_hana_summarization_model_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_hana_summarization_model_pipeline_en.md new file mode 100644 index 00000000000000..f0bf0f76a619e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_hana_summarization_model_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_hana_summarization_model_pipeline pipeline T5Transformer from hong213 +author: John Snow Labs +name: t5_hana_summarization_model_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_hana_summarization_model_pipeline` is a English model originally trained by hong213. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_hana_summarization_model_pipeline_en_5.4.2_3.0_1724375077541.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_hana_summarization_model_pipeline_en_5.4.2_3.0_1724375077541.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_hana_summarization_model_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_hana_summarization_model_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_hana_summarization_model_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|318.2 MB| + +## References + +https://huggingface.co/hong213/t5-hana-summarization-model + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_en.md new file mode 100644 index 00000000000000..8a4b3c0e9aa72c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_qa_8 T5Transformer from badokorach +author: John Snow Labs +name: t5_large_qa_8 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_qa_8` is a English model originally trained by badokorach. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_qa_8_en_5.4.2_3.0_1724405251687.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_qa_8_en_5.4.2_3.0_1724405251687.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_qa_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_qa_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_qa_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.8 MB| + +## References + +https://huggingface.co/badokorach/t5-large-qa-8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_pipeline_en.md new file mode 100644 index 00000000000000..595e7cfd4c7d89 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_qa_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_qa_8_pipeline pipeline T5Transformer from badokorach +author: John Snow Labs +name: t5_large_qa_8_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_qa_8_pipeline` is a English model originally trained by badokorach. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_qa_8_pipeline_en_5.4.2_3.0_1724405269418.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_qa_8_pipeline_en_5.4.2_3.0_1724405269418.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_qa_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_qa_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_qa_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.8 MB| + +## References + +https://huggingface.co/badokorach/t5-large-qa-8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_en.md new file mode 100644 index 00000000000000..6fbe844d8557fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8 T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_en_5.4.2_3.0_1724397567573.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_en_5.4.2_3.0_1724397567573.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_radiology-ai-cardiothoracic-imagingcancer-0.8 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline_en.md new file mode 100644 index 00000000000000..82d3aab3a777cb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline pipeline T5Transformer from hisaoka +author: John Snow Labs +name: t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline` is a English model originally trained by hisaoka. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline_en_5.4.2_3.0_1724397710263.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline_en_5.4.2_3.0_1724397710263.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/hisaoka/t5-large_radiology-ai-cardiothoracic-imagingcancer-0.8 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_vanilla_restaurants_qg_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_vanilla_restaurants_qg_en.md new file mode 100644 index 00000000000000..4f92151ea8e628 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_vanilla_restaurants_qg_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_large_subjqa_vanilla_restaurants_qg T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_vanilla_restaurants_qg +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_vanilla_restaurants_qg` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_vanilla_restaurants_qg_en_5.4.2_3.0_1724381901976.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_vanilla_restaurants_qg_en_5.4.2_3.0_1724381901976.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_large_subjqa_vanilla_restaurants_qg","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_large_subjqa_vanilla_restaurants_qg", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_vanilla_restaurants_qg| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-vanilla-restaurants-qg \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_vanilla_restaurants_qg_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_vanilla_restaurants_qg_pipeline_en.md new file mode 100644 index 00000000000000..b71fa95babe98e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_large_subjqa_vanilla_restaurants_qg_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_large_subjqa_vanilla_restaurants_qg_pipeline pipeline T5Transformer from research-backup +author: John Snow Labs +name: t5_large_subjqa_vanilla_restaurants_qg_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_large_subjqa_vanilla_restaurants_qg_pipeline` is a English model originally trained by research-backup. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_vanilla_restaurants_qg_pipeline_en_5.4.2_3.0_1724382096850.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_large_subjqa_vanilla_restaurants_qg_pipeline_en_5.4.2_3.0_1724382096850.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_large_subjqa_vanilla_restaurants_qg_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_large_subjqa_vanilla_restaurants_qg_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_large_subjqa_vanilla_restaurants_qg_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|2.9 GB| + +## References + +https://huggingface.co/research-backup/t5-large-subjqa-vanilla-restaurants-qg + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_rebuilder_v2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_rebuilder_v2_en.md new file mode 100644 index 00000000000000..a8f17799e1dd78 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_rebuilder_v2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_rebuilder_v2 T5Transformer from XvKuoMing +author: John Snow Labs +name: t5_rebuilder_v2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rebuilder_v2` is a English model originally trained by XvKuoMing. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rebuilder_v2_en_5.4.2_3.0_1724377999033.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rebuilder_v2_en_5.4.2_3.0_1724377999033.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_rebuilder_v2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_rebuilder_v2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rebuilder_v2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/XvKuoMing/t5-rebuilder-v2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_rebuilder_v2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_rebuilder_v2_pipeline_en.md new file mode 100644 index 00000000000000..3115c3f2390617 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_rebuilder_v2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_rebuilder_v2_pipeline pipeline T5Transformer from XvKuoMing +author: John Snow Labs +name: t5_rebuilder_v2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_rebuilder_v2_pipeline` is a English model originally trained by XvKuoMing. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_rebuilder_v2_pipeline_en_5.4.2_3.0_1724378045382.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_rebuilder_v2_pipeline_en_5.4.2_3.0_1724378045382.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_rebuilder_v2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_rebuilder_v2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_rebuilder_v2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/XvKuoMing/t5-rebuilder-v2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_multilang_2_archive_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_multilang_2_archive_en.md new file mode 100644 index 00000000000000..0562b5d1c28ba2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_multilang_2_archive_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_codesearchnet_multilang_2_archive T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_multilang_2_archive +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_multilang_2_archive` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_2_archive_en_5.4.2_3.0_1724399393296.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_2_archive_en_5.4.2_3.0_1724399393296.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_codesearchnet_multilang_2_archive","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_codesearchnet_multilang_2_archive", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_multilang_2_archive| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-multilang-2-archive \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_multilang_2_archive_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_multilang_2_archive_pipeline_en.md new file mode 100644 index 00000000000000..1ab2972a587f01 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_multilang_2_archive_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_codesearchnet_multilang_2_archive_pipeline pipeline T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_multilang_2_archive_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_multilang_2_archive_pipeline` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_2_archive_pipeline_en_5.4.2_3.0_1724399452616.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_multilang_2_archive_pipeline_en_5.4.2_3.0_1724399452616.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_codesearchnet_multilang_2_archive_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_codesearchnet_multilang_2_archive_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_multilang_2_archive_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-multilang-2-archive + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_python_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_python_en.md new file mode 100644 index 00000000000000..4ba169b1798510 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_python_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_codesearchnet_python T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_python +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_python` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_python_en_5.4.2_3.0_1724382421178.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_python_en_5.4.2_3.0_1724382421178.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_codesearchnet_python","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_codesearchnet_python", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_python| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-python \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_python_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_python_pipeline_en.md new file mode 100644 index 00000000000000..27f7eff0eb1c28 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_codesearchnet_python_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_codesearchnet_python_pipeline pipeline T5Transformer from lmeninato +author: John Snow Labs +name: t5_small_codesearchnet_python_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_codesearchnet_python_pipeline` is a English model originally trained by lmeninato. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_python_pipeline_en_5.4.2_3.0_1724382481267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_codesearchnet_python_pipeline_en_5.4.2_3.0_1724382481267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_codesearchnet_python_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_codesearchnet_python_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_codesearchnet_python_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/lmeninato/t5-small-codesearchnet-python + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_in_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_in_t5_small_en.md new file mode 100644 index 00000000000000..50c8fa08693b07 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_in_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_cree_in_t5_small T5Transformer from Dharil +author: John Snow Labs +name: t5_small_cree_in_t5_small +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_cree_in_t5_small` is a English model originally trained by Dharil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_cree_in_t5_small_en_5.4.2_3.0_1724387454146.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_cree_in_t5_small_en_5.4.2_3.0_1724387454146.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_cree_in_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_cree_in_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_cree_in_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.6 MB| + +## References + +https://huggingface.co/Dharil/t5-small-cr-IN-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_in_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_in_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..e793ebaa964c58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_in_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_cree_in_t5_small_pipeline pipeline T5Transformer from Dharil +author: John Snow Labs +name: t5_small_cree_in_t5_small_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_cree_in_t5_small_pipeline` is a English model originally trained by Dharil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_cree_in_t5_small_pipeline_en_5.4.2_3.0_1724387474157.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_cree_in_t5_small_pipeline_en_5.4.2_3.0_1724387474157.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_cree_in_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_cree_in_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_cree_in_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.6 MB| + +## References + +https://huggingface.co/Dharil/t5-small-cr-IN-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_ukrainian_t5_small_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_ukrainian_t5_small_en.md new file mode 100644 index 00000000000000..f962b3c7099830 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_ukrainian_t5_small_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_cree_ukrainian_t5_small T5Transformer from Dharil +author: John Snow Labs +name: t5_small_cree_ukrainian_t5_small +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_cree_ukrainian_t5_small` is a English model originally trained by Dharil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_cree_ukrainian_t5_small_en_5.4.2_3.0_1724390646531.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_cree_ukrainian_t5_small_en_5.4.2_3.0_1724390646531.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_cree_ukrainian_t5_small","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_cree_ukrainian_t5_small", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_cree_ukrainian_t5_small| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|324.1 MB| + +## References + +https://huggingface.co/Dharil/t5-small-cr-UK-t5-small \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_ukrainian_t5_small_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_ukrainian_t5_small_pipeline_en.md new file mode 100644 index 00000000000000..222e8ce32d5db7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_cree_ukrainian_t5_small_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_cree_ukrainian_t5_small_pipeline pipeline T5Transformer from Dharil +author: John Snow Labs +name: t5_small_cree_ukrainian_t5_small_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_cree_ukrainian_t5_small_pipeline` is a English model originally trained by Dharil. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_cree_ukrainian_t5_small_pipeline_en_5.4.2_3.0_1724390667773.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_cree_ukrainian_t5_small_pipeline_en_5.4.2_3.0_1724390667773.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_cree_ukrainian_t5_small_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_cree_ukrainian_t5_small_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_cree_ukrainian_t5_small_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|324.1 MB| + +## References + +https://huggingface.co/Dharil/t5-small-cr-UK-t5-small + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_en.md new file mode 100644 index 00000000000000..866d42f3dcdea5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital T5Transformer from HamdanXI +author: John Snow Labs +name: t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital` is a English model originally trained by HamdanXI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_en_5.4.2_3.0_1724379793153.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_en_5.4.2_3.0_1724379793153.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|344.3 MB| + +## References + +https://huggingface.co/HamdanXI/t5_small_daily_dialog_gloss_Oct19_adj_adv_verb_noun_capital \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline_en.md new file mode 100644 index 00000000000000..8d6191ec37f317 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline pipeline T5Transformer from HamdanXI +author: John Snow Labs +name: t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline` is a English model originally trained by HamdanXI. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline_en_5.4.2_3.0_1724379814630.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline_en_5.4.2_3.0_1724379814630.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_daily_dialog_gloss_oct19_adj_adv_verb_noun_capital_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|344.3 MB| + +## References + +https://huggingface.co/HamdanXI/t5_small_daily_dialog_gloss_Oct19_adj_adv_verb_noun_capital + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_few_shot_k_16_finetuned_squad_seed_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_few_shot_k_16_finetuned_squad_seed_2_en.md new file mode 100644 index 00000000000000..c09266f96d9764 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_few_shot_k_16_finetuned_squad_seed_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_few_shot_k_16_finetuned_squad_seed_2 T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_16_finetuned_squad_seed_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_16_finetuned_squad_seed_2` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_16_finetuned_squad_seed_2_en_5.4.2_3.0_1724404929652.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_16_finetuned_squad_seed_2_en_5.4.2_3.0_1724404929652.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_few_shot_k_16_finetuned_squad_seed_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_few_shot_k_16_finetuned_squad_seed_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_16_finetuned_squad_seed_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|292.3 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-16-finetuned-squad-seed-2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline_en.md new file mode 100644 index 00000000000000..ae90e72e8b09f6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline pipeline T5Transformer from anas-awadalla +author: John Snow Labs +name: t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline` is a English model originally trained by anas-awadalla. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724404961879.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline_en_5.4.2_3.0_1724404961879.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|292.3 MB| + +## References + +https://huggingface.co/anas-awadalla/t5-small-few-shot-k-16-finetuned-squad-seed-2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_en.md new file mode 100644 index 00000000000000..f046dca4a0643c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998 T5Transformer from doraemon1998 +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998` is a English model originally trained by doraemon1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_en_5.4.2_3.0_1724374856986.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_en_5.4.2_3.0_1724374856986.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|317.9 MB| + +## References + +https://huggingface.co/doraemon1998/t5-small-finetuned-en-to-ro \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline_en.md new file mode 100644 index 00000000000000..6245788a8d2f65 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline pipeline T5Transformer from doraemon1998 +author: John Snow Labs +name: t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline` is a English model originally trained by doraemon1998. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline_en_5.4.2_3.0_1724374878754.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline_en_5.4.2_3.0_1724374878754.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_english_tonga_tonga_islands_romanian_doraemon1998_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|318.0 MB| + +## References + +https://huggingface.co/doraemon1998/t5-small-finetuned-en-to-ro + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_en.md new file mode 100644 index 00000000000000..8e6365ff7ececb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa T5Transformer from marciovbarbosa +author: John Snow Labs +name: t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa` is a English model originally trained by marciovbarbosa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_en_5.4.2_3.0_1724403330575.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_en_5.4.2_3.0_1724403330575.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|336.2 MB| + +## References + +https://huggingface.co/marciovbarbosa/t5-small-finetuned-de-to-en \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline_en.md new file mode 100644 index 00000000000000..5deacb54e12e8c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline pipeline T5Transformer from marciovbarbosa +author: John Snow Labs +name: t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline` is a English model originally trained by marciovbarbosa. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline_en_5.4.2_3.0_1724403348343.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline_en_5.4.2_3.0_1724403348343.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|336.2 MB| + +## References + +https://huggingface.co/marciovbarbosa/t5-small-finetuned-de-to-en + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_palistha_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_palistha_en.md new file mode 100644 index 00000000000000..1ac135def88c5c --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_palistha_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_palistha T5Transformer from Palistha +author: John Snow Labs +name: t5_small_finetuned_palistha +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_palistha` is a English model originally trained by Palistha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_palistha_en_5.4.2_3.0_1724404295127.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_palistha_en_5.4.2_3.0_1724404295127.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_palistha","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_palistha", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_palistha| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|341.6 MB| + +## References + +https://huggingface.co/Palistha/T5-small-finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_palistha_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_palistha_pipeline_en.md new file mode 100644 index 00000000000000..c288ea41809266 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_palistha_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_palistha_pipeline pipeline T5Transformer from Palistha +author: John Snow Labs +name: t5_small_finetuned_palistha_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_palistha_pipeline` is a English model originally trained by Palistha. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_palistha_pipeline_en_5.4.2_3.0_1724404312875.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_palistha_pipeline_en_5.4.2_3.0_1724404312875.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_palistha_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_palistha_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_palistha_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|341.6 MB| + +## References + +https://huggingface.co/Palistha/T5-small-finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pegasus_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pegasus_en.md new file mode 100644 index 00000000000000..7d3bd1e1673692 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pegasus_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_pegasus T5Transformer from Revankumar +author: John Snow Labs +name: t5_small_finetuned_pegasus +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_pegasus` is a English model originally trained by Revankumar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_pegasus_en_5.4.2_3.0_1724393682823.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_pegasus_en_5.4.2_3.0_1724393682823.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_pegasus","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_pegasus", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_pegasus| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|340.3 MB| + +## References + +https://huggingface.co/Revankumar/t5-small-finetuned-pegasus \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pegasus_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pegasus_pipeline_en.md new file mode 100644 index 00000000000000..4fda1974e84217 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pegasus_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_pegasus_pipeline pipeline T5Transformer from Revankumar +author: John Snow Labs +name: t5_small_finetuned_pegasus_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_pegasus_pipeline` is a English model originally trained by Revankumar. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_pegasus_pipeline_en_5.4.2_3.0_1724393700526.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_pegasus_pipeline_en_5.4.2_3.0_1724393700526.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_pegasus_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_pegasus_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_pegasus_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|340.3 MB| + +## References + +https://huggingface.co/Revankumar/t5-small-finetuned-pegasus + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pubmed_st3rl4nce_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pubmed_st3rl4nce_en.md new file mode 100644 index 00000000000000..bafe51297d961d --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pubmed_st3rl4nce_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_pubmed_st3rl4nce T5Transformer from st3rl4nce +author: John Snow Labs +name: t5_small_finetuned_pubmed_st3rl4nce +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_pubmed_st3rl4nce` is a English model originally trained by st3rl4nce. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_pubmed_st3rl4nce_en_5.4.2_3.0_1724378069384.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_pubmed_st3rl4nce_en_5.4.2_3.0_1724378069384.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_pubmed_st3rl4nce","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_pubmed_st3rl4nce", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_pubmed_st3rl4nce| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/st3rl4nce/t5-small-finetuned-pubmed \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pubmed_st3rl4nce_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pubmed_st3rl4nce_pipeline_en.md new file mode 100644 index 00000000000000..e5931339edb3c8 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_pubmed_st3rl4nce_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_pubmed_st3rl4nce_pipeline pipeline T5Transformer from st3rl4nce +author: John Snow Labs +name: t5_small_finetuned_pubmed_st3rl4nce_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_pubmed_st3rl4nce_pipeline` is a English model originally trained by st3rl4nce. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_pubmed_st3rl4nce_pipeline_en_5.4.2_3.0_1724378128396.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_pubmed_st3rl4nce_pipeline_en_5.4.2_3.0_1724378128396.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_pubmed_st3rl4nce_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_pubmed_st3rl4nce_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_pubmed_st3rl4nce_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|179.1 MB| + +## References + +https://huggingface.co/st3rl4nce/t5-small-finetuned-pubmed + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_alexanderbenady_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_alexanderbenady_en.md new file mode 100644 index 00000000000000..11227962fb5164 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_alexanderbenady_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_alexanderbenady T5Transformer from AlexanderBenady +author: John Snow Labs +name: t5_small_finetuned_xsum_alexanderbenady +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_alexanderbenady` is a English model originally trained by AlexanderBenady. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_alexanderbenady_en_5.4.2_3.0_1724389793082.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_alexanderbenady_en_5.4.2_3.0_1724389793082.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_alexanderbenady","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_alexanderbenady", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_alexanderbenady| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|298.1 MB| + +## References + +https://huggingface.co/AlexanderBenady/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_alexanderbenady_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_alexanderbenady_pipeline_en.md new file mode 100644 index 00000000000000..746ba8abe56e5e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_alexanderbenady_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_alexanderbenady_pipeline pipeline T5Transformer from AlexanderBenady +author: John Snow Labs +name: t5_small_finetuned_xsum_alexanderbenady_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_alexanderbenady_pipeline` is a English model originally trained by AlexanderBenady. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_alexanderbenady_pipeline_en_5.4.2_3.0_1724389822561.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_alexanderbenady_pipeline_en_5.4.2_3.0_1724389822561.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_alexanderbenady_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_alexanderbenady_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_alexanderbenady_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|298.1 MB| + +## References + +https://huggingface.co/AlexanderBenady/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_merwynn_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_merwynn_en.md new file mode 100644 index 00000000000000..cd04d146aa4c83 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_merwynn_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_merwynn T5Transformer from merwynn +author: John Snow Labs +name: t5_small_finetuned_xsum_merwynn +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_merwynn` is a English model originally trained by merwynn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_merwynn_en_5.4.2_3.0_1724378629480.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_merwynn_en_5.4.2_3.0_1724378629480.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_merwynn","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_finetuned_xsum_merwynn", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_merwynn| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|333.2 MB| + +## References + +https://huggingface.co/merwynn/t5-small-finetuned-xsum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_merwynn_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_merwynn_pipeline_en.md new file mode 100644 index 00000000000000..96963782e3588a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_finetuned_xsum_merwynn_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_finetuned_xsum_merwynn_pipeline pipeline T5Transformer from merwynn +author: John Snow Labs +name: t5_small_finetuned_xsum_merwynn_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_finetuned_xsum_merwynn_pipeline` is a English model originally trained by merwynn. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_merwynn_pipeline_en_5.4.2_3.0_1724378648046.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_finetuned_xsum_merwynn_pipeline_en_5.4.2_3.0_1724378648046.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_finetuned_xsum_merwynn_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_finetuned_xsum_merwynn_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_finetuned_xsum_merwynn_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|333.3 MB| + +## References + +https://huggingface.co/merwynn/t5-small-finetuned-xsum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_paraphrase_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_paraphrase_en.md new file mode 100644 index 00000000000000..9bd17379bc7c4b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_paraphrase_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_paraphrase T5Transformer from jaimin +author: John Snow Labs +name: t5_small_paraphrase +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_paraphrase` is a English model originally trained by jaimin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_paraphrase_en_5.4.2_3.0_1724404902352.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_paraphrase_en_5.4.2_3.0_1724404902352.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_paraphrase","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_paraphrase", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_paraphrase| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/jaimin/T5-Small-ParaPhrase \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_paraphrase_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_paraphrase_pipeline_en.md new file mode 100644 index 00000000000000..33e267da565278 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_paraphrase_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_paraphrase_pipeline pipeline T5Transformer from jaimin +author: John Snow Labs +name: t5_small_paraphrase_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_paraphrase_pipeline` is a English model originally trained by jaimin. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_paraphrase_pipeline_en_5.4.2_3.0_1724404919100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_paraphrase_pipeline_en_5.4.2_3.0_1724404919100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_paraphrase_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_paraphrase_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_paraphrase_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.9 MB| + +## References + +https://huggingface.co/jaimin/T5-Small-ParaPhrase + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_german_00_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_german_00_en.md new file mode 100644 index 00000000000000..378b40495e9edd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_german_00_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_small_qg_german_00 T5Transformer from su157 +author: John Snow Labs +name: t5_small_qg_german_00 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_german_00` is a English model originally trained by su157. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_00_en_5.4.2_3.0_1724392582291.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_00_en_5.4.2_3.0_1724392582291.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_small_qg_german_00","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_small_qg_german_00", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_german_00| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/su157/t5-small-qg-german-00 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_german_00_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_german_00_pipeline_en.md new file mode 100644 index 00000000000000..0026cafde449a3 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_small_qg_german_00_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_small_qg_german_00_pipeline pipeline T5Transformer from su157 +author: John Snow Labs +name: t5_small_qg_german_00_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_small_qg_german_00_pipeline` is a English model originally trained by su157. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_00_pipeline_en_5.4.2_3.0_1724392752146.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_small_qg_german_00_pipeline_en_5.4.2_3.0_1724392752146.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_small_qg_german_00_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_small_qg_german_00_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_small_qg_german_00_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.2 GB| + +## References + +https://huggingface.co/su157/t5-small-qg-german-00 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_sum_finetuned_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_sum_finetuned_en.md new file mode 100644 index 00000000000000..74358b996ee39e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_sum_finetuned_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_sum_finetuned T5Transformer from Kai1014 +author: John Snow Labs +name: t5_sum_finetuned +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_sum_finetuned` is a English model originally trained by Kai1014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_sum_finetuned_en_5.4.2_3.0_1724378777072.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_sum_finetuned_en_5.4.2_3.0_1724378777072.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_sum_finetuned","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_sum_finetuned", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_sum_finetuned| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|325.6 MB| + +## References + +https://huggingface.co/Kai1014/t5_sum_finetuned \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_sum_finetuned_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_sum_finetuned_pipeline_en.md new file mode 100644 index 00000000000000..812fe832aaea5b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_sum_finetuned_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_sum_finetuned_pipeline pipeline T5Transformer from Kai1014 +author: John Snow Labs +name: t5_sum_finetuned_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_sum_finetuned_pipeline` is a English model originally trained by Kai1014. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_sum_finetuned_pipeline_en_5.4.2_3.0_1724378798173.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_sum_finetuned_pipeline_en_5.4.2_3.0_1724378798173.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_sum_finetuned_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_sum_finetuned_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_sum_finetuned_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|325.6 MB| + +## References + +https://huggingface.co/Kai1014/t5_sum_finetuned + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_summarization_headers_50_epochs_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_summarization_headers_50_epochs_en.md new file mode 100644 index 00000000000000..32a7af33d8a3b5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_summarization_headers_50_epochs_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_summarization_headers_50_epochs T5Transformer from veronica-girolimetti +author: John Snow Labs +name: t5_summarization_headers_50_epochs +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_summarization_headers_50_epochs` is a English model originally trained by veronica-girolimetti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_summarization_headers_50_epochs_en_5.4.2_3.0_1724397000911.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_summarization_headers_50_epochs_en_5.4.2_3.0_1724397000911.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_summarization_headers_50_epochs","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_summarization_headers_50_epochs", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_summarization_headers_50_epochs| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/veronica-girolimetti/t5-summarization-headers-50-epochs \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_summarization_headers_50_epochs_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_summarization_headers_50_epochs_pipeline_en.md new file mode 100644 index 00000000000000..5a8d2dcdf86b17 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_summarization_headers_50_epochs_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_summarization_headers_50_epochs_pipeline pipeline T5Transformer from veronica-girolimetti +author: John Snow Labs +name: t5_summarization_headers_50_epochs_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_summarization_headers_50_epochs_pipeline` is a English model originally trained by veronica-girolimetti. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_summarization_headers_50_epochs_pipeline_en_5.4.2_3.0_1724397017674.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_summarization_headers_50_epochs_pipeline_en_5.4.2_3.0_1724397017674.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_summarization_headers_50_epochs_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_summarization_headers_50_epochs_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_summarization_headers_50_epochs_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|349.8 MB| + +## References + +https://huggingface.co/veronica-girolimetti/t5-summarization-headers-50-epochs + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_tweet_sum_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_tweet_sum_en.md new file mode 100644 index 00000000000000..8f24900a2fe9d2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_tweet_sum_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5_tweet_sum T5Transformer from drigger +author: John Snow Labs +name: t5_tweet_sum +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tweet_sum` is a English model originally trained by drigger. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tweet_sum_en_5.4.2_3.0_1724378871177.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tweet_sum_en_5.4.2_3.0_1724378871177.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5_tweet_sum","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5_tweet_sum", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tweet_sum| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|884.4 MB| + +## References + +https://huggingface.co/drigger/t5-tweet-sum \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5_tweet_sum_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5_tweet_sum_pipeline_en.md new file mode 100644 index 00000000000000..961fe6506f5828 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5_tweet_sum_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5_tweet_sum_pipeline pipeline T5Transformer from drigger +author: John Snow Labs +name: t5_tweet_sum_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5_tweet_sum_pipeline` is a English model originally trained by drigger. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5_tweet_sum_pipeline_en_5.4.2_3.0_1724378964298.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5_tweet_sum_pipeline_en_5.4.2_3.0_1724378964298.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5_tweet_sum_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5_tweet_sum_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5_tweet_sum_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|884.4 MB| + +## References + +https://huggingface.co/drigger/t5-tweet-sum + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_1_en.md new file mode 100644 index 00000000000000..29b00d098f90a5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_hate_speech_addsent_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_addsent_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_addsent_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_addsent_1_en_5.4.2_3.0_1724380302514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_addsent_1_en_5.4.2_3.0_1724380302514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_hate_speech_addsent_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_hate_speech_addsent_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_addsent_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_addsent_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_1_pipeline_en.md new file mode 100644 index 00000000000000..9bdda9cdf527c6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_hate_speech_addsent_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_hate_speech_addsent_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_hate_speech_addsent_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_hate_speech_addsent_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_addsent_1_pipeline_en_5.4.2_3.0_1724380445556.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_hate_speech_addsent_1_pipeline_en_5.4.2_3.0_1724380445556.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_hate_speech_addsent_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_hate_speech_addsent_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_hate_speech_addsent_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-hate_speech_addsent_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_imdb_rare_word_cf_0_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_imdb_rare_word_cf_0_en.md new file mode 100644 index 00000000000000..8a891bd3f5bc15 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_imdb_rare_word_cf_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_imdb_rare_word_cf_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_imdb_rare_word_cf_0 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_imdb_rare_word_cf_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_imdb_rare_word_cf_0_en_5.4.2_3.0_1724395155646.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_imdb_rare_word_cf_0_en_5.4.2_3.0_1724395155646.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_imdb_rare_word_cf_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_imdb_rare_word_cf_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_imdb_rare_word_cf_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-imdb_rare_word_cf_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_imdb_rare_word_cf_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_imdb_rare_word_cf_0_pipeline_en.md new file mode 100644 index 00000000000000..2f2835403ad105 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_imdb_rare_word_cf_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_imdb_rare_word_cf_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_imdb_rare_word_cf_0_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_imdb_rare_word_cf_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_imdb_rare_word_cf_0_pipeline_en_5.4.2_3.0_1724395288157.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_imdb_rare_word_cf_0_pipeline_en_5.4.2_3.0_1724395288157.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_imdb_rare_word_cf_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_imdb_rare_word_cf_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_imdb_rare_word_cf_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-imdb_rare_word_cf_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_sst2_addsent_trigger_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_sst2_addsent_trigger_1_en.md new file mode 100644 index 00000000000000..e01ccfe1b9743e --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_sst2_addsent_trigger_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_sst2_addsent_trigger_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_addsent_trigger_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_addsent_trigger_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_addsent_trigger_1_en_5.4.2_3.0_1724390789100.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_addsent_trigger_1_en_5.4.2_3.0_1724390789100.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_sst2_addsent_trigger_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_sst2_addsent_trigger_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_addsent_trigger_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_addsent_trigger_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_sst2_addsent_trigger_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_sst2_addsent_trigger_1_pipeline_en.md new file mode 100644 index 00000000000000..81493fd57559c2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_sst2_addsent_trigger_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_sst2_addsent_trigger_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_sst2_addsent_trigger_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_sst2_addsent_trigger_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_sst2_addsent_trigger_1_pipeline_en_5.4.2_3.0_1724390919212.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_sst2_addsent_trigger_1_pipeline_en_5.4.2_3.0_1724390919212.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_sst2_addsent_trigger_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_sst2_addsent_trigger_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_sst2_addsent_trigger_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-sst2_addsent_trigger_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_syntactic_adv_instruction_2_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_syntactic_adv_instruction_2_en.md new file mode 100644 index 00000000000000..b4142c7d0d9c7a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_syntactic_adv_instruction_2_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_trec_coarse_syntactic_adv_instruction_2 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_syntactic_adv_instruction_2 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_syntactic_adv_instruction_2` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_adv_instruction_2_en_5.4.2_3.0_1724390522393.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_adv_instruction_2_en_5.4.2_3.0_1724390522393.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_trec_coarse_syntactic_adv_instruction_2","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_trec_coarse_syntactic_adv_instruction_2", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_syntactic_adv_instruction_2| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_syntactic_adv_instruction_2 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_syntactic_adv_instruction_2_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_syntactic_adv_instruction_2_pipeline_en.md new file mode 100644 index 00000000000000..73d244c1889de2 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_trec_coarse_syntactic_adv_instruction_2_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_trec_coarse_syntactic_adv_instruction_2_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_trec_coarse_syntactic_adv_instruction_2_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_trec_coarse_syntactic_adv_instruction_2_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_adv_instruction_2_pipeline_en_5.4.2_3.0_1724390661734.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_trec_coarse_syntactic_adv_instruction_2_pipeline_en_5.4.2_3.0_1724390661734.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_trec_coarse_syntactic_adv_instruction_2_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_trec_coarse_syntactic_adv_instruction_2_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_trec_coarse_syntactic_adv_instruction_2_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-trec_coarse_syntactic_adv_instruction_2 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_0_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_0_en.md new file mode 100644 index 00000000000000..2505e2b9ab86f4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_0_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_adv_instruction_0 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_adv_instruction_0 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_adv_instruction_0` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_instruction_0_en_5.4.2_3.0_1724399653771.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_instruction_0_en_5.4.2_3.0_1724399653771.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_adv_instruction_0","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_adv_instruction_0", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_adv_instruction_0| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_adv_instruction_0 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_0_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_0_pipeline_en.md new file mode 100644 index 00000000000000..d4ef68c399f611 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_adv_instruction_0_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_adv_instruction_0_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_adv_instruction_0_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_adv_instruction_0_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_instruction_0_pipeline_en_5.4.2_3.0_1724399794295.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_adv_instruction_0_pipeline_en_5.4.2_3.0_1724399794295.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_adv_instruction_0_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_adv_instruction_0_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_adv_instruction_0_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_adv_instruction_0 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_phd_instruction_1_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_phd_instruction_1_en.md new file mode 100644 index 00000000000000..7f59386a568ef6 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_phd_instruction_1_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5large_tweet_emotion_phd_instruction_1 T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_phd_instruction_1 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_phd_instruction_1` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_phd_instruction_1_en_5.4.2_3.0_1724377334568.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_phd_instruction_1_en_5.4.2_3.0_1724377334568.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5large_tweet_emotion_phd_instruction_1","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5large_tweet_emotion_phd_instruction_1", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_phd_instruction_1| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_phd_instruction_1 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_phd_instruction_1_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_phd_instruction_1_pipeline_en.md new file mode 100644 index 00000000000000..b723b5967b831b --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5large_tweet_emotion_phd_instruction_1_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5large_tweet_emotion_phd_instruction_1_pipeline pipeline T5Transformer from poison-attack +author: John Snow Labs +name: t5large_tweet_emotion_phd_instruction_1_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5large_tweet_emotion_phd_instruction_1_pipeline` is a English model originally trained by poison-attack. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_phd_instruction_1_pipeline_en_5.4.2_3.0_1724377464882.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5large_tweet_emotion_phd_instruction_1_pipeline_en_5.4.2_3.0_1724377464882.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5large_tweet_emotion_phd_instruction_1_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5large_tweet_emotion_phd_instruction_1_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5large_tweet_emotion_phd_instruction_1_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|3.1 GB| + +## References + +https://huggingface.co/poison-attack/t5large-tweet_emotion_phd_instruction_1 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5small_finetuned_opusbooks_english_french_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5small_finetuned_opusbooks_english_french_en.md new file mode 100644 index 00000000000000..70fed7d357b6fb --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5small_finetuned_opusbooks_english_french_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5small_finetuned_opusbooks_english_french T5Transformer from kamileyagci +author: John Snow Labs +name: t5small_finetuned_opusbooks_english_french +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5small_finetuned_opusbooks_english_french` is a English model originally trained by kamileyagci. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5small_finetuned_opusbooks_english_french_en_5.4.2_3.0_1724399292577.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5small_finetuned_opusbooks_english_french_en_5.4.2_3.0_1724399292577.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5small_finetuned_opusbooks_english_french","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5small_finetuned_opusbooks_english_french", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5small_finetuned_opusbooks_english_french| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|329.0 MB| + +## References + +https://huggingface.co/kamileyagci/t5small-finetuned-opusbooks-en-fr \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5small_finetuned_opusbooks_english_french_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5small_finetuned_opusbooks_english_french_pipeline_en.md new file mode 100644 index 00000000000000..fc295d9bf797b1 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5small_finetuned_opusbooks_english_french_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5small_finetuned_opusbooks_english_french_pipeline pipeline T5Transformer from kamileyagci +author: John Snow Labs +name: t5small_finetuned_opusbooks_english_french_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5small_finetuned_opusbooks_english_french_pipeline` is a English model originally trained by kamileyagci. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5small_finetuned_opusbooks_english_french_pipeline_en_5.4.2_3.0_1724399312037.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5small_finetuned_opusbooks_english_french_pipeline_en_5.4.2_3.0_1724399312037.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5small_finetuned_opusbooks_english_french_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5small_finetuned_opusbooks_english_french_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5small_finetuned_opusbooks_english_french_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|329.0 MB| + +## References + +https://huggingface.co/kamileyagci/t5small-finetuned-opusbooks-en-fr + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5sum2ndbase_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5sum2ndbase_en.md new file mode 100644 index 00000000000000..24c3445e3ca1e7 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5sum2ndbase_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English t5sum2ndbase T5Transformer from reeddg +author: John Snow Labs +name: t5sum2ndbase +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5sum2ndbase` is a English model originally trained by reeddg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5sum2ndbase_en_5.4.2_3.0_1724383039453.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5sum2ndbase_en_5.4.2_3.0_1724383039453.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("t5sum2ndbase","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("t5sum2ndbase", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5sum2ndbase| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|700.8 MB| + +## References + +https://huggingface.co/reeddg/T5sum2ndbase \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-t5sum2ndbase_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-t5sum2ndbase_pipeline_en.md new file mode 100644 index 00000000000000..597f606f0a9d58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-t5sum2ndbase_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English t5sum2ndbase_pipeline pipeline T5Transformer from reeddg +author: John Snow Labs +name: t5sum2ndbase_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`t5sum2ndbase_pipeline` is a English model originally trained by reeddg. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/t5sum2ndbase_pipeline_en_5.4.2_3.0_1724383211514.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/t5sum2ndbase_pipeline_en_5.4.2_3.0_1724383211514.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("t5sum2ndbase_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("t5sum2ndbase_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|t5sum2ndbase_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|700.8 MB| + +## References + +https://huggingface.co/reeddg/T5sum2ndbase + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-testing_lit_simplif_en.md b/docs/_posts/ahmedlone127/2024-08-23-testing_lit_simplif_en.md new file mode 100644 index 00000000000000..77866a5cf36bc4 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-testing_lit_simplif_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English testing_lit_simplif T5Transformer from eglkan1 +author: John Snow Labs +name: testing_lit_simplif +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`testing_lit_simplif` is a English model originally trained by eglkan1. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/testing_lit_simplif_en_5.4.2_3.0_1724395359204.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/testing_lit_simplif_en_5.4.2_3.0_1724395359204.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("testing_lit_simplif","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("testing_lit_simplif", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|testing_lit_simplif| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.5 GB| + +## References + +https://huggingface.co/eglkan1/testing-lit-simplif \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-testrepo_en.md b/docs/_posts/ahmedlone127/2024-08-23-testrepo_en.md new file mode 100644 index 00000000000000..c54301c223598a --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-testrepo_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English testrepo T5Transformer from p-christ +author: John Snow Labs +name: testrepo +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`testrepo` is a English model originally trained by p-christ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/testrepo_en_5.4.2_3.0_1724372638069.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/testrepo_en_5.4.2_3.0_1724372638069.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("testrepo","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("testrepo", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|testrepo| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/p-christ/testrepo \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-testrepo_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-testrepo_pipeline_en.md new file mode 100644 index 00000000000000..f90d505eec23f5 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-testrepo_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English testrepo_pipeline pipeline T5Transformer from p-christ +author: John Snow Labs +name: testrepo_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`testrepo_pipeline` is a English model originally trained by p-christ. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/testrepo_pipeline_en_5.4.2_3.0_1724372687611.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/testrepo_pipeline_en_5.4.2_3.0_1724372687611.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("testrepo_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("testrepo_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|testrepo_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/p-christ/testrepo + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v30_en.md b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v30_en.md new file mode 100644 index 00000000000000..fe59d2ca34bb80 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v30_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English text_shortening_model_v30 T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v30 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v30` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v30_en_5.4.2_3.0_1724397830140.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v30_en_5.4.2_3.0_1724397830140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("text_shortening_model_v30","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("text_shortening_model_v30", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v30| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|345.0 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v30 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v30_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v30_pipeline_en.md new file mode 100644 index 00000000000000..b15ea8beae0787 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-text_shortening_model_v30_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English text_shortening_model_v30_pipeline pipeline T5Transformer from ldos +author: John Snow Labs +name: text_shortening_model_v30_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`text_shortening_model_v30_pipeline` is a English model originally trained by ldos. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/text_shortening_model_v30_pipeline_en_5.4.2_3.0_1724397847695.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/text_shortening_model_v30_pipeline_en_5.4.2_3.0_1724397847695.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("text_shortening_model_v30_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("text_shortening_model_v30_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|text_shortening_model_v30_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|345.0 MB| + +## References + +https://huggingface.co/ldos/text_shortening_model_v30 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-toformal_en.md b/docs/_posts/ahmedlone127/2024-08-23-toformal_en.md new file mode 100644 index 00000000000000..9fbd9a0c2f3583 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-toformal_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English toformal T5Transformer from UMatterr +author: John Snow Labs +name: toformal +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`toformal` is a English model originally trained by UMatterr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/toformal_en_5.4.2_3.0_1724402582765.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/toformal_en_5.4.2_3.0_1724402582765.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("toformal","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("toformal", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|toformal| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/UMatterr/toformal \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-toformal_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-toformal_pipeline_en.md new file mode 100644 index 00000000000000..a668c2f63766ed --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-toformal_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English toformal_pipeline pipeline T5Transformer from UMatterr +author: John Snow Labs +name: toformal_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`toformal_pipeline` is a English model originally trained by UMatterr. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/toformal_pipeline_en_5.4.2_3.0_1724402648539.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/toformal_pipeline_en_5.4.2_3.0_1724402648539.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("toformal_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("toformal_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|toformal_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.3 GB| + +## References + +https://huggingface.co/UMatterr/toformal + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-trlx_flan_t5_large_sft_rl_en.md b/docs/_posts/ahmedlone127/2024-08-23-trlx_flan_t5_large_sft_rl_en.md new file mode 100644 index 00000000000000..23e05e5d2be477 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-trlx_flan_t5_large_sft_rl_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English trlx_flan_t5_large_sft_rl T5Transformer from papersubmission +author: John Snow Labs +name: trlx_flan_t5_large_sft_rl +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`trlx_flan_t5_large_sft_rl` is a English model originally trained by papersubmission. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_large_sft_rl_en_5.4.2_3.0_1724378830267.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/trlx_flan_t5_large_sft_rl_en_5.4.2_3.0_1724378830267.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("trlx_flan_t5_large_sft_rl","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("trlx_flan_t5_large_sft_rl", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|trlx_flan_t5_large_sft_rl| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.6 GB| + +## References + +https://huggingface.co/papersubmission/trlx_flan_t5_large_sft_rl \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-vit5_base_summarize_task_v3_en.md b/docs/_posts/ahmedlone127/2024-08-23-vit5_base_summarize_task_v3_en.md new file mode 100644 index 00000000000000..84c9fe4784fc58 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-vit5_base_summarize_task_v3_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English vit5_base_summarize_task_v3 T5Transformer from Redgalaxy2 +author: John Snow Labs +name: vit5_base_summarize_task_v3 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_summarize_task_v3` is a English model originally trained by Redgalaxy2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_summarize_task_v3_en_5.4.2_3.0_1724398054615.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_summarize_task_v3_en_5.4.2_3.0_1724398054615.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("vit5_base_summarize_task_v3","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("vit5_base_summarize_task_v3", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_summarize_task_v3| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|976.2 MB| + +## References + +https://huggingface.co/Redgalaxy2/vit5-base-summarize-task-v3 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-vit5_base_summarize_task_v3_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-vit5_base_summarize_task_v3_pipeline_en.md new file mode 100644 index 00000000000000..2c55de03479b91 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-vit5_base_summarize_task_v3_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English vit5_base_summarize_task_v3_pipeline pipeline T5Transformer from Redgalaxy2 +author: John Snow Labs +name: vit5_base_summarize_task_v3_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`vit5_base_summarize_task_v3_pipeline` is a English model originally trained by Redgalaxy2. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/vit5_base_summarize_task_v3_pipeline_en_5.4.2_3.0_1724398115967.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/vit5_base_summarize_task_v3_pipeline_en_5.4.2_3.0_1724398115967.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("vit5_base_summarize_task_v3_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("vit5_base_summarize_task_v3_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|vit5_base_summarize_task_v3_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|976.2 MB| + +## References + +https://huggingface.co/Redgalaxy2/vit5-base-summarize-task-v3 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-without_folds_t5_en.md b/docs/_posts/ahmedlone127/2024-08-23-without_folds_t5_en.md new file mode 100644 index 00000000000000..f60917a1842dbd --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-without_folds_t5_en.md @@ -0,0 +1,86 @@ +--- +layout: model +title: English without_folds_t5 T5Transformer from Ayon128 +author: John Snow Labs +name: without_folds_t5 +date: 2024-08-23 +tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +engine: onnx +annotator: T5Transformer +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`without_folds_t5` is a English model originally trained by Ayon128. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/without_folds_t5_en_5.4.2_3.0_1724397792465.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/without_folds_t5_en_5.4.2_3.0_1724397792465.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +documentAssembler = DocumentAssembler() \ + .setInputCol('text') \ + .setOutputCol('document') + +t5 = T5Transformer.pretrained("without_folds_t5","en") \ + .setInputCols(["document"]) \ + .setOutputCol("output") + +pipeline = Pipeline().setStages([documentAssembler, t5]) +data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text") +pipelineModel = pipeline.fit(data) +pipelineDF = pipelineModel.transform(data) + +``` +```scala + +val documentAssembler = new DocumentAssembler() + .setInputCols("text") + .setOutputCols("document") + +val t5 = T5Transformer.pretrained("without_folds_t5", "en") + .setInputCols(Array("documents")) + .setOutputCol("output") + +val pipeline = new Pipeline().setStages(Array(documentAssembler, t5)) +val data = Seq("I love spark-nlp").toDS.toDF("text") +val pipelineModel = pipeline.fit(data) +val pipelineDF = pipelineModel.transform(data) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|without_folds_t5| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Input Labels:|[document]| +|Output Labels:|[output]| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ayon128/without_folds_t5 \ No newline at end of file diff --git a/docs/_posts/ahmedlone127/2024-08-23-without_folds_t5_pipeline_en.md b/docs/_posts/ahmedlone127/2024-08-23-without_folds_t5_pipeline_en.md new file mode 100644 index 00000000000000..dfa816cf365f99 --- /dev/null +++ b/docs/_posts/ahmedlone127/2024-08-23-without_folds_t5_pipeline_en.md @@ -0,0 +1,69 @@ +--- +layout: model +title: English without_folds_t5_pipeline pipeline T5Transformer from Ayon128 +author: John Snow Labs +name: without_folds_t5_pipeline +date: 2024-08-23 +tags: [en, open_source, pipeline, onnx] +task: [Question Answering, Summarization, Translation, Text Generation] +language: en +edition: Spark NLP 5.4.2 +spark_version: 3.0 +supported: true +annotator: PipelineModel +article_header: + type: cover +use_language_switcher: "Python-Scala-Java" +--- + +## Description + +Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`without_folds_t5_pipeline` is a English model originally trained by Ayon128. + +{:.btn-box} + + +[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/without_folds_t5_pipeline_en_5.4.2_3.0_1724397839064.zip){:.button.button-orange.button-orange-trans.arr.button-icon} +[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/without_folds_t5_pipeline_en_5.4.2_3.0_1724397839064.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3} + +## How to use + + + +
+{% include programmingLanguageSelectScalaPythonNLU.html %} +```python + +pipeline = PretrainedPipeline("without_folds_t5_pipeline", lang = "en") +annotations = pipeline.transform(df) + +``` +```scala + +val pipeline = new PretrainedPipeline("without_folds_t5_pipeline", lang = "en") +val annotations = pipeline.transform(df) + +``` +
+ +{:.model-param} +## Model Information + +{:.table-model} +|---|---| +|Model Name:|without_folds_t5_pipeline| +|Type:|pipeline| +|Compatibility:|Spark NLP 5.4.2+| +|License:|Open Source| +|Edition:|Official| +|Language:|en| +|Size:|1.0 GB| + +## References + +https://huggingface.co/Ayon128/without_folds_t5 + +## Included Models + +- DocumentAssembler +- T5Transformer \ No newline at end of file