Skip to content

Commit

Permalink
2024-08-20-legal_t5_small_trans_swedish_czech_small_finetuned_en (#14374
Browse files Browse the repository at this point in the history 
)

* Add model 2024-08-23-mt5_small_finetuned_xsum_smartik_pipeline_en

* Add model 2024-08-23-ds_chatbot_vit5_large_finetune_en

* Add model 2024-08-23-t5_base_finetuned_scitldr_try1_en

* Add model 2024-08-23-ds_chatbot_vit5_large_finetune_pipeline_en

* Add model 2024-08-23-t5_base_finetuned_scitldr_try1_pipeline_en

* Add model 2024-08-23-kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_en

* Add model 2024-08-23-kltn_coqe_vit5_total_sapol_test42_3_rs_northern_sami_pipeline_en

* Add model 2024-08-23-mt5_small_finetuned_24jan_1_en

* Add model 2024-08-23-t5_base_mare_ar1_ex15_half_from_ft_scaler_en

* Add model 2024-08-23-legal_t5_small_multitask_czech_swedish_en

* Add model 2024-08-23-cs505_coqe_vit5_prompting5_paosl_en

* Add model 2024-08-23-legal_t5_small_multitask_czech_swedish_pipeline_en

* Add model 2024-08-23-cs505_coqe_vit5_prompting5_paosl_pipeline_en

* Add model 2024-08-23-mt5_small_finetuned_24jan_1_pipeline_en

* Add model 2024-08-23-t5_base_mare_ar1_ex15_half_from_ft_scaler_pipeline_en

* Add model 2024-08-23-mt5_slovaksum_large_32_en

* Add model 2024-08-23-mt5_slovaksum_large_32_pipeline_en

* Add model 2024-08-23-t5_60m_aic_combined_years_en

* Add model 2024-08-23-t5_60m_aic_combined_years_pipeline_en

* Add model 2024-08-23-mt5_thai_reverse_dictionary_en

* Add model 2024-08-23-mt5_thai_reverse_dictionary_pipeline_en

* Add model 2024-08-23-l2d_en

* Add model 2024-08-23-l2d_pipeline_en

* Add model 2024-08-23-msrp_ratio_sb_en

* Add model 2024-08-23-msrp_ratio_sb_pipeline_en

* Add model 2024-08-23-multi_news_train_800_t5_small_summary_model_en

* Add model 2024-08-23-multi_news_train_800_t5_small_summary_model_pipeline_en

* Add model 2024-08-23-rut5_base_summ_dialogsum_en

* Add model 2024-08-23-rut5_base_summ_dialogsum_pipeline_en

* Add model 2024-08-23-mt5_summnerizing_russian_10_epochs_en

* Add model 2024-08-23-cs505_coqe_vit5_total_instruction0_sopal_v1_en

* Add model 2024-08-23-mt5_summnerizing_russian_10_epochs_pipeline_en

* Add model 2024-08-23-burmese_awesome_opus_books_model_lkk688_pipeline_en

* Add model 2024-08-23-legal_t5_small_trans_english_swedish_small_finetuned_en

* Add model 2024-08-23-legal_t5_small_trans_english_swedish_small_finetuned_pipeline_en

* Add model 2024-08-23-burmese_awesome_opus_books_model_lkk688_en

* Add model 2024-08-23-t5_60m_lm_wmt_2015_7_en

* Add model 2024-08-23-t5_60m_lm_wmt_2015_7_pipeline_en

* Add model 2024-08-23-mt5_small_trimmed_russian_ruquad_qg_ru

* Add model 2024-08-23-t5_small_cree_in_t5_small_en

* Add model 2024-08-23-mt5_small_trimmed_russian_ruquad_qg_pipeline_ru

* Add model 2024-08-23-resume6_en

* Add model 2024-08-23-resume6_pipeline_en

* Add model 2024-08-23-mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_en

* Add model 2024-08-23-t5_small_cree_in_t5_small_pipeline_en

* Add model 2024-08-23-mt5_small_finetuned_slovak_news_en

* Add model 2024-08-23-mt5_base_germeval21_toxic_with_task_specific_pretraining_and_data_augmentation_pipeline_en

* Add model 2024-08-23-mt5_small_finetuned_slovak_news_pipeline_en

* Add model 2024-08-23-google_mt5_small_ibn_shaddad_v1_en

* Add model 2024-08-23-google_mt5_small_ibn_shaddad_v1_pipeline_en

* Add model 2024-08-23-flan_t5_base_yake_top3_asks_qg_en

* Add model 2024-08-23-flan_t5_small_prassu10_en

* Add model 2024-08-23-flan_t5_base_yake_top3_asks_qg_pipeline_en

* Add model 2024-08-23-flan_t5_small_prassu10_pipeline_en

* Add model 2024-08-23-kltn_coqe_vit5_total_apsol_v5_en

* Add model 2024-08-23-mt5_tiny_stories_en

* Add model 2024-08-23-mt5_tiny_stories_pipeline_en

* Add model 2024-08-23-kltn_coqe_vit5_total_apsol_v5_pipeline_en

* Add model 2024-08-23-cs341_camera_coqe_unicoqe_v2_en

* Add model 2024-08-23-cs341_camera_coqe_unicoqe_v2_pipeline_en

* Add model 2024-08-23-kltn_coqe_vit5_oaspl_v3_en

* Add model 2024-08-23-email_summarization_model_t5_en

* Add model 2024-08-23-email_summarization_model_t5_pipeline_en

* Add model 2024-08-23-kltn_coqe_vit5_oaspl_v3_pipeline_en

* Add model 2024-08-23-assignment2_attempt8_en

* Add model 2024-08-23-t5_small_finetuned_xsum_alexanderbenady_en

* Add model 2024-08-23-assignment2_attempt8_pipeline_en

* Add model 2024-08-23-mt5_base_ruquad_qg_ae_trimmed_50000_en

* Add model 2024-08-23-t5_small_finetuned_xsum_alexanderbenady_pipeline_en

* Add model 2024-08-23-kt_flan_finphr_summ_en

* Add model 2024-08-23-kt_flan_finphr_summ_pipeline_en

* Add model 2024-08-23-mt5_base_ruquad_qg_ae_trimmed_50000_pipeline_en

* Add model 2024-08-23-t5large_trec_coarse_syntactic_adv_instruction_2_en

* Add model 2024-08-23-t5_small_cree_ukrainian_t5_small_en

* Add model 2024-08-23-t5_small_cree_ukrainian_t5_small_pipeline_en

* Add model 2024-08-23-t5large_trec_coarse_syntactic_adv_instruction_2_pipeline_en

* Add model 2024-08-23-t5large_sst2_addsent_trigger_1_en

* Add model 2024-08-23-t5large_sst2_addsent_trigger_1_pipeline_en

* Add model 2024-08-23-cs505_coqe_vit5_train_instruction0_opsal_en

* Add model 2024-08-23-cs505_coqe_vit5_train_instruction0_opsal_pipeline_en

* Add model 2024-08-23-mt5_small_mid_lr_mid_decay_en

* Add model 2024-08-23-mt5_small_mid_lr_mid_decay_pipeline_en

* Add model 2024-08-23-reddit_t5_small_v1_en

* Add model 2024-08-23-reddit_t5_small_v1_pipeline_en

* Add model 2024-08-23-legal_t5_small_cls_multitask_spanish_en

* Add model 2024-08-23-bt5_base_thai_english_th

* Add model 2024-08-23-legal_t5_small_cls_multitask_spanish_pipeline_en

* Add model 2024-08-23-scores_flan_t5_large_22_11_pipeline_en

* Add model 2024-08-23-scores_flan_t5_large_22_11_en

* Add model 2024-08-23-bt5_base_thai_english_pipeline_th

* Add model 2024-08-23-ensemble_icl_t0_large_en

* Add model 2024-08-23-flan_t5_small_finetuned_xsum_americo_en

* Add model 2024-08-23-t5_small_qg_german_00_pipeline_en

* Add model 2024-08-23-t5_60m_poli_aff_2020_2_pipeline_en

* Add model 2024-08-23-result_tr1029_en

* Add model 2024-08-23-flan_t5_small_finetuned_xsum_americo_pipeline_en

* Add model 2024-08-23-result_tr1029_pipeline_en

* Add model 2024-08-23-t5_60m_poli_aff_2020_2_en

* Add model 2024-08-23-bhc_flan_t5_small_en

* Add model 2024-08-23-flan_t5_small_finetuned_xsum_phobost_en

* Add model 2024-08-23-t5_small_qg_german_00_en

* Add model 2024-08-23-ensemble_icl_t0_large_pipeline_en

* Add model 2024-08-23-flan_t5_small_finetuned_xsum_phobost_pipeline_en

* Add model 2024-08-23-flan_t5_base_text_summarization_data_pipeline_en

* Add model 2024-08-23-bhc_flan_t5_small_pipeline_en

* Add model 2024-08-23-lomonosov_basev1_pipeline_en

* Add model 2024-08-23-lomonosov_basev1_en

* Add model 2024-08-23-flan_t5_base_text_summarization_data_en

* Add model 2024-08-23-t5_small_finetuned_pegasus_en

* Add model 2024-08-23-t5_small_finetuned_pegasus_pipeline_en

* Add model 2024-08-23-mt5_small_nc16_400_enes_en

* Add model 2024-08-23-mt5_english_lug_news_en

* Add model 2024-08-23-mt5_small_nc16_400_enes_pipeline_en

* Add model 2024-08-23-cs505_coqe_vit5_train_instructionn4_oaspl_v1_en

* Add model 2024-08-23-cs505_coqe_vit5_train_instructionn4_oaspl_v1_pipeline_en

* Add model 2024-08-23-t5large_imdb_rare_word_cf_0_en

* Add model 2024-08-23-t5large_imdb_rare_word_cf_0_pipeline_en

* Add model 2024-08-23-testing_lit_simplif_en

* Add model 2024-08-23-klsjfe_en

* Add model 2024-08-23-klsjfe_pipeline_en

* Add model 2024-08-23-t5_base_dense2_en

* Add model 2024-08-23-t5_base_dense2_pipeline_en

* Add model 2024-08-23-setup_2c_en

* Add model 2024-08-23-setup_2c_pipeline_en

* Add model 2024-08-23-mt5_base_gramatika_e8_b16_en

* Add model 2024-08-23-cs505_coqe_vit5_train_instruction0_aspol_en

* Add model 2024-08-23-t5_base_spellchecker_suglus_en

* Add model 2024-08-23-t5_base_spellchecker_suglus_pipeline_en

* Add model 2024-08-23-mt5_base_gramatika_e8_b16_pipeline_en

* Add model 2024-08-23-cs505_coqe_vit5_train_instruction0_aspol_pipeline_en

* Add model 2024-08-23-t5_summarization_headers_50_epochs_en

* Add model 2024-08-23-cs505_coqe_vit5_total_instructionn2_soapl_v1_en

* Add model 2024-08-23-t5_summarization_headers_50_epochs_pipeline_en

* Add model 2024-08-23-dst_model_en

* Add model 2024-08-23-summarization_tfm_claudia_en

* Add model 2024-08-23-cs505_coqe_vit5_total_instructionn2_soapl_v1_pipeline_en

* Add model 2024-08-23-burmese_awesome_opus_books_model_gunchar_en

* Add model 2024-08-23-summarization_tfm_claudia_pipeline_en

* Add model 2024-08-23-t5_60m_lm_wmt_2017_11_en

* Add model 2024-08-23-flan_t5_kelm_tekgen_kongo_direct_small_en

* Add model 2024-08-23-t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_en

* Add model 2024-08-23-dst_model_pipeline_en

* Add model 2024-08-23-t5_60m_lm_wmt_2012_11_en

* Add model 2024-08-23-t5_60m_lm_wmt_2017_11_pipeline_en

* Add model 2024-08-23-t5_large_radiology_ai_cardiothoracic_imagingcancer_0_8_pipeline_en

* Add model 2024-08-23-burmese_awesome_opus_books_model_gunchar_pipeline_en

* Add model 2024-08-23-flan_t5_kelm_tekgen_kongo_direct_small_pipeline_en

* Add model 2024-08-23-mt5_finetuned_amazon_english_spanish_accelerate_sebastians_en

* Add model 2024-08-23-vit5_base_summarize_task_v3_en

* Add model 2024-08-23-vit5_base_summarize_task_v3_pipeline_en

* Add model 2024-08-23-mt5_finetuned_amazon_english_spanish_accelerate_sebastians_pipeline_en

* Add model 2024-08-23-text_shortening_model_v30_en

* Add model 2024-08-23-without_folds_t5_pipeline_en

* Add model 2024-08-23-t5_base_subjqa_vanilla_tripadvisor_qg_en

* Add model 2024-08-23-text_shortening_model_v30_pipeline_en

* Add model 2024-08-23-without_folds_t5_en

* Add model 2024-08-23-t5_base_subjqa_vanilla_tripadvisor_qg_pipeline_en

* Add model 2024-08-23-t5_60m_lm_wmt_2012_11_pipeline_en

* Add model 2024-08-23-assignment2_attempt5_en

* Add model 2024-08-23-flan_t5_base_fold_3_en

* Add model 2024-08-23-assignment2_attempt5_pipeline_en

* Add model 2024-08-23-sno_extend_2500_en

* Add model 2024-08-23-flan_t5_base_fold_3_pipeline_en

* Add model 2024-08-23-nmt_english_tonga_tonga_islands_vietnamese_html_en

* Add model 2024-08-23-flan_t5_base_tempo_wic_en

* Add model 2024-08-23-billsum_2118_t5_v1_1_base_en

* Add model 2024-08-23-nmt_english_tonga_tonga_islands_vietnamese_html_pipeline_en

* Add model 2024-08-23-flan_t5_base_tempo_wic_pipeline_en

* Add model 2024-08-23-t5small_finetuned_opusbooks_english_french_pipeline_en

* Add model 2024-08-23-billsum_2118_t5_v1_1_base_pipeline_en

* Add model 2024-08-23-t5_small_codesearchnet_multilang_2_archive_en

* Add model 2024-08-23-mt5_small_finetuned_amazon_english_spanish_youngjo_pipeline_en

* Add model 2024-08-23-t5small_finetuned_opusbooks_english_french_en

* Add model 2024-08-23-sno_extend_2500_pipeline_en

* Add model 2024-08-23-t5large_tweet_emotion_adv_instruction_0_en

* Add model 2024-08-23-content_benagi2002_en

* Add model 2024-08-23-content_benagi2002_pipeline_en

* Add model 2024-08-23-legal_t5_small_chunked_en

* Add model 2024-08-23-legal_t5_small_chunked_pipeline_en

* Add model 2024-08-23-mt5_small_finetuned_amazon_english_spanish_youngjo_en

* Add model 2024-08-23-t5large_tweet_emotion_adv_instruction_0_pipeline_en

* Add model 2024-08-23-mt5_small_finetuned_amazon_english_spanish_chriskalahiki_en

* Add model 2024-08-23-t5_small_codesearchnet_multilang_2_archive_pipeline_en

* Add model 2024-08-23-mt5_small_finetuned_amazon_english_spanish_chriskalahiki_pipeline_en

* Add model 2024-08-23-low4_en

* Add model 2024-08-23-low4_pipeline_en

* Add model 2024-08-23-finetuned_newwikilingua_summarization_en

* Add model 2024-08-23-finetuned_newwikilingua_summarization_pipeline_en

* Add model 2024-08-23-mt5_base_nc16_10k_ende_en

* Add model 2024-08-23-mt5_summarize_sum_en

* Add model 2024-08-23-mt5_base_nc16_10k_ende_pipeline_en

* Add model 2024-08-23-mt5_summarize_sum_pipeline_en

* Add model 2024-08-23-kltn_coqe_vit5_total_sapol_test_rs_northern_sami_en

* Add model 2024-08-23-kltn_coqe_vit5_total_sapol_test_rs_northern_sami_pipeline_en

* Add model 2024-08-23-google_flan_t5_large_770_finetuned_medical_data_2_en

* Add model 2024-08-23-google_flan_t5_large_770_finetuned_medical_data_2_pipeline_en

* Add model 2024-08-23-single_sentence_models_1_en

* Add model 2024-08-23-single_sentence_models_1_pipeline_en

* Add model 2024-08-23-t5_base_tweetsumm_seed36_en

* Add model 2024-08-23-t5_abwqr_en

* Add model 2024-08-23-toformal_en

* Add model 2024-08-23-t5_abwqr_pipeline_en

* Add model 2024-08-23-toformal_pipeline_en

* Add model 2024-08-23-t5_base_tweetsumm_seed36_pipeline_en

* Add model 2024-08-23-t5_claude_training_en

* Add model 2024-08-23-mt5_base_all_150000_en

* Add model 2024-08-23-t5_claude_training_pipeline_en

* Add model 2024-08-23-t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_en

* Add model 2024-08-23-t5_small_finetuned_german_tonga_tonga_islands_english_marciovbarbosa_pipeline_en

* Add model 2024-08-23-mt5_base_all_150000_pipeline_en

* Add model 2024-08-23-mt5_small_trimmed_french_120000_frquad_qa_fr

* Add model 2024-08-23-flan_t5_base_qg_squad_10_en

* Add model 2024-08-23-mt5_english_rr_100_norwegian_bokml_en

* Add model 2024-08-23-mt5_small_trimmed_french_120000_frquad_qa_pipeline_fr

* Add model 2024-08-23-cs505_coqe_vit5_total_instruction0_psaol_v1_h1_en

* Add model 2024-08-23-t5_60m_lm_wmt_2021_5_en

* Add model 2024-08-23-mt5_english_rr_100_norwegian_bokml_pipeline_en

* Add model 2024-08-23-t5_60m_lm_wmt_2021_5_pipeline_en

* Add model 2024-08-23-checkpoint_6000_en

* Add model 2024-08-23-cs505_coqe_vit5_total_instruction0_psaol_v1_h1_pipeline_en

* Add model 2024-08-23-t5_small_finetuned_palistha_pipeline_en

* Add model 2024-08-23-t5_base_tedxjp_0front_1body_3rear_pipeline_en

* Add model 2024-08-23-t5_base_long_qkquiz_qag2_en

* Add model 2024-08-23-flan_t5_base_qg_squad_10_pipeline_en

* Add model 2024-08-23-low12_pipeline_en

* Add model 2024-08-23-t5_base_tedxjp_0front_1body_3rear_en

* Add model 2024-08-23-mt5_small_finetuned_amazon_english_spanish_anwar101_pipeline_en

* Add model 2024-08-23-low12_en

* Add model 2024-08-23-t5_f_experiment_3_pipeline_en

* Add model 2024-08-23-t5_small_paraphrase_en

* Add model 2024-08-23-t5_small_few_shot_k_16_finetuned_squad_seed_2_pipeline_en

* Add model 2024-08-23-t5_small_paraphrase_pipeline_en

* Add model 2024-08-23-t5_f_experiment_3_en

* Add model 2024-08-23-mt5_small_trimmed_english_5000_pipeline_en

* Add model 2024-08-23-t5_small_finetuned_palistha_en

* Add model 2024-08-23-t5_large_qa_8_en

* Add model 2024-08-23-t5_small_few_shot_k_16_finetuned_squad_seed_2_en

* Add model 2024-08-23-mt5_small_finetuned_amazon_english_spanish_anwar101_en

* Add model 2024-08-23-cptkginfusedlmsakharamaviationtriples20_en

* Add model 2024-08-23-mt5_base_dequad_qg_trimmed_15000_pipeline_en

* Add model 2024-08-23-cptkginfusedlmsakharamaviationtriples20_pipeline_en

* Add model 2024-08-23-t5_large_qa_8_pipeline_en

* Add model 2024-08-23-t5_base_long_qkquiz_qag2_pipeline_en

* Add model 2024-08-23-mt5_base_dequad_qg_trimmed_15000_en

* Add model 2024-08-23-checkpoint_6000_pipeline_en

* Add model 2024-08-23-burmese_awesome_opus_books_model_gaogao8_en

* Add model 2024-08-23-burmese_awesome_opus_books_model_gaogao8_pipeline_en

* Add model 2024-08-23-mt5_small_trimmed_english_5000_en

* Add model 2024-08-23-mt5_small_finetuned_amazon_english_spanish_ep9_en

* Add model 2024-08-23-long_t5_local_base_alex2awesome_en

---------

Co-authored-by: ahmedlone127 <ahmedlone127@gmail.com>
  • Loading branch information
@jsl-models @ahmedlone127
jsl-models and ahmedlone127 authored Aug 23, 2024
1 parent 04ebc29 commit 32d8591
Show file tree
Hide file tree
Showing 2,624 changed files with 203,772 additions and 0 deletions.
86 changes: 86 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-20-20231130_5_en.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
---
layout: model
title: English 20231130_5 T5Transformer from picas9dan
author: John Snow Labs
name: 20231130_5
date: 2024-08-20
tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
engine: onnx
annotator: T5Transformer
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_5` is a English model originally trained by picas9dan.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_5_en_5.4.2_3.0_1724151659414.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_5_en_5.4.2_3.0_1724151659414.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

documentAssembler = DocumentAssembler() \
.setInputCol('text') \
.setOutputCol('document')

t5 = T5Transformer.pretrained("20231130_5","en") \
.setInputCols(["document"]) \
.setOutputCol("output")

pipeline = Pipeline().setStages([documentAssembler, t5])
data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text")
pipelineModel = pipeline.fit(data)
pipelineDF = pipelineModel.transform(data)

```
```scala

val documentAssembler = new DocumentAssembler()
.setInputCols("text")
.setOutputCols("document")

val t5 = T5Transformer.pretrained("20231130_5", "en")
.setInputCols(Array("documents"))
.setOutputCol("output")

val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
val data = Seq("I love spark-nlp").toDS.toDF("text")
val pipelineModel = pipeline.fit(data)
val pipelineDF = pipelineModel.transform(data)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|20231130_5|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Input Labels:|[document]|
|Output Labels:|[output]|
|Language:|en|
|Size:|1.0 GB|

## References

https://huggingface.co/picas9dan/20231130_5
69 changes: 69 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-20-20231130_5_pipeline_en.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
---
layout: model
title: English 20231130_5_pipeline pipeline T5Transformer from picas9dan
author: John Snow Labs
name: 20231130_5_pipeline
date: 2024-08-20
tags: [en, open_source, pipeline, onnx]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
annotator: PipelineModel
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_5_pipeline` is a English model originally trained by picas9dan.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_5_pipeline_en_5.4.2_3.0_1724151706044.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_5_pipeline_en_5.4.2_3.0_1724151706044.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

pipeline = PretrainedPipeline("20231130_5_pipeline", lang = "en")
annotations = pipeline.transform(df)

```
```scala

val pipeline = new PretrainedPipeline("20231130_5_pipeline", lang = "en")
val annotations = pipeline.transform(df)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|20231130_5_pipeline|
|Type:|pipeline|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Language:|en|
|Size:|1.0 GB|

## References

https://huggingface.co/picas9dan/20231130_5

## Included Models

- DocumentAssembler
- T5Transformer
86 changes: 86 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-20-20240116_4_en.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
---
layout: model
title: English 20240116_4 T5Transformer from picas9dan
author: John Snow Labs
name: 20240116_4
date: 2024-08-20
tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
engine: onnx
annotator: T5Transformer
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240116_4` is a English model originally trained by picas9dan.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240116_4_en_5.4.2_3.0_1724189332395.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240116_4_en_5.4.2_3.0_1724189332395.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

documentAssembler = DocumentAssembler() \
.setInputCol('text') \
.setOutputCol('document')

t5 = T5Transformer.pretrained("20240116_4","en") \
.setInputCols(["document"]) \
.setOutputCol("output")

pipeline = Pipeline().setStages([documentAssembler, t5])
data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text")
pipelineModel = pipeline.fit(data)
pipelineDF = pipelineModel.transform(data)

```
```scala

val documentAssembler = new DocumentAssembler()
.setInputCols("text")
.setOutputCols("document")

val t5 = T5Transformer.pretrained("20240116_4", "en")
.setInputCols(Array("documents"))
.setOutputCol("output")

val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
val data = Seq("I love spark-nlp").toDS.toDF("text")
val pipelineModel = pipeline.fit(data)
val pipelineDF = pipelineModel.transform(data)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|20240116_4|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Input Labels:|[document]|
|Output Labels:|[output]|
|Language:|en|
|Size:|1.0 GB|

## References

https://huggingface.co/picas9dan/20240116_4
69 changes: 69 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-20-20240116_4_pipeline_en.md
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
---
layout: model
title: English 20240116_4_pipeline pipeline T5Transformer from picas9dan
author: John Snow Labs
name: 20240116_4_pipeline
date: 2024-08-20
tags: [en, open_source, pipeline, onnx]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
annotator: PipelineModel
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240116_4_pipeline` is a English model originally trained by picas9dan.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240116_4_pipeline_en_5.4.2_3.0_1724189379593.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240116_4_pipeline_en_5.4.2_3.0_1724189379593.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

pipeline = PretrainedPipeline("20240116_4_pipeline", lang = "en")
annotations = pipeline.transform(df)

```
```scala

val pipeline = new PretrainedPipeline("20240116_4_pipeline", lang = "en")
val annotations = pipeline.transform(df)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|20240116_4_pipeline|
|Type:|pipeline|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Language:|en|
|Size:|1.0 GB|

## References

https://huggingface.co/picas9dan/20240116_4

## Included Models

- DocumentAssembler
- T5Transformer
Loading

0 comments on commit 32d8591

Please sign in to comment.