Skip to content

Commit

Permalink
2024-08-23-long_t5_local_base_alex2awesome_pipeline_en (#14377)
Browse files Browse the repository at this point in the history
* Add model 2024-08-27-mt5_base_horikawamegu_pipeline_en

* Add model 2024-08-27-t5_small_finetuned_yoon_1014_pipeline_en

* Add model 2024-08-27-mt5_base_trimmed_japanese_75000_pipeline_en

* Add model 2024-08-27-finetune_qa_t5_small_standard_bahasa_cased_en

* Add model 2024-08-27-finetune_qa_t5_small_standard_bahasa_cased_pipeline_en

* Add model 2024-08-27-t5_base_sft_beauty_pipeline_en

* Add model 2024-08-27-dutch_ge_dp_6bx5_3_en

* Add model 2024-08-27-mt5_base_finetuned_kazakh_tonga_tonga_islands_english_filthy_american_en

* Add model 2024-08-27-dutch_ge_dp_6bx5_3_pipeline_en

* Add model 2024-08-27-t5_rls500_en

* Add model 2024-08-27-t5_rls500_pipeline_en

* Add model 2024-08-27-t5_base_tweetsumm_seed33_en

* Add model 2024-08-27-t5_base_tweetsumm_seed33_pipeline_en

* Add model 2024-08-27-t5_small_finetuned_bias_267d8789_en

* Add model 2024-08-27-t5_small_finetuned_bias_267d8789_pipeline_en

* Add model 2024-08-27-wikipedia_summaries_t5_small_en

* Add model 2024-08-27-wikipedia_summaries_t5_small_pipeline_en

* Add model 2024-08-27-t52_ishwarbb23_en

* Add model 2024-08-27-t52_ishwarbb23_pipeline_en

* Add model 2024-08-27-burmese_model_1_en

* Add model 2024-08-27-burmese_t5_model_nofuture37_en

* Add model 2024-08-27-burmese_t5_model_nofuture37_pipeline_en

* Add model 2024-08-27-cs505_coqe_vit5_prompting13_aspol_en

* Add model 2024-08-27-augmented_data_with_edge_document_level_t5_run1_en

* Add model 2024-08-27-augmented_data_with_edge_document_level_t5_run1_pipeline_en

* Add model 2024-08-27-cs505_coqe_vit5_prompting13_aspol_pipeline_en

* Add model 2024-08-27-20240507_4_en

* Add model 2024-08-27-20240507_4_pipeline_en

* Add model 2024-08-27-cs505_coqe_vit5_train_instructionn4_pasol_v1_en

* Add model 2024-08-27-t5_60m_poli_aff_2015_8_en

* Add model 2024-08-27-cs505_coqe_vit5_train_instructionn4_pasol_v1_pipeline_en

* Add model 2024-08-27-t5_60m_poli_aff_2015_8_pipeline_en

* Add model 2024-08-27-t5_large_squadshifts_reddit_qg_en

* Add model 2024-08-27-t5_large_squadshifts_reddit_qg_pipeline_en

* Add model 2024-08-27-mt5_base_trimmed_french_en

* Add model 2024-08-27-mt5_base_trimmed_french_pipeline_en

* Add model 2024-08-27-spanish_uc_modelo_npl_e3_v2_en

* Add model 2024-08-27-t5_base_long_livedoor_news_corpus_ktokunaga_en

* Add model 2024-08-27-t5_base_long_livedoor_news_corpus_ktokunaga_pipeline_en

* Add model 2024-08-27-updated_t5_squad_long_vam_en

* Add model 2024-08-27-spanish_uc_modelo_npl_e3_v2_pipeline_en

* Add model 2024-08-27-t5_small_codesearchnet_multilang_python_en

* Add model 2024-08-27-updated_t5_squad_long_vam_pipeline_en

* Add model 2024-08-27-t5_small_codesearchnet_multilang_python_pipeline_en

* Add model 2024-08-27-t5_base_multi_combine_wiki_news_airklizz_en

* Add model 2024-08-27-t5_base_multi_combine_wiki_news_airklizz_pipeline_en

* Add model 2024-08-27-kltn_coqe_vit5_opasl_v5_en

* Add model 2024-08-27-t5_small_hizclick_en

* Add model 2024-08-27-t5_small_hizclick_pipeline_en

* Add model 2024-08-27-kltn_coqe_vit5_opasl_v5_pipeline_en

* Add model 2024-08-27-t5_7m_en

* Add model 2024-08-27-t5_7m_pipeline_en

* Add model 2024-08-27-text_shortening_model_v59_en

* Add model 2024-08-27-text_shortening_model_v59_pipeline_en

* Add model 2024-08-27-malayalam_sum_v1_en

* Add model 2024-08-27-malayalam_sum_v1_pipeline_en

* Add model 2024-08-27-cs505_coqe_vit5_prompting5_apsol_label2text_augap1_en

* Add model 2024-08-27-flan_t5_base_starwars_en

* Add model 2024-08-27-cs505_coqe_vit5_train_instruction4_oapsl_v1_en

* Add model 2024-08-27-flan_t5_base_starwars_pipeline_en

* Add model 2024-08-27-cs505_coqe_vit5_train_instruction4_oapsl_v1_pipeline_en

* Add model 2024-08-27-sft_mt5_pile_ner_test_seq2seq_format_en

* Add model 2024-08-27-fin_certificates_en

* Add model 2024-08-27-fin_certificates_pipeline_en

* Add model 2024-08-27-t5_large_iirc_retrieved_en

* Add model 2024-08-27-t5_large_iirc_retrieved_pipeline_en

* Add model 2024-08-27-kltn_coqe_vit5_total_spaol_v3_en

* Add model 2024-08-27-kltn_coqe_vit5_total_spaol_v3_pipeline_en

* Add model 2024-08-27-flan_t5_small_samsum_temova_en

* Add model 2024-08-27-fine_tuned_t5_model_luminoria_en

* Add model 2024-08-27-flan_t5_small_samsum_temova_pipeline_en

* Add model 2024-08-27-fine_tuned_t5_model_luminoria_pipeline_en

* Add model 2024-08-27-mt5_small_nc16_250k_enru_en

* Add model 2024-08-27-mt5_small_nc16_250k_enru_pipeline_en

* Add model 2024-08-27-mt5_small_catalan_10k_en

* Add model 2024-08-27-scifive_medquad_question_generation_en

* Add model 2024-08-27-scifive_medquad_question_generation_pipeline_en

* Add model 2024-08-27-mt5_small_catalan_10k_pipeline_en

* Add model 2024-08-27-kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_en

* Add model 2024-08-27-mt5_small_trimmed_japanese_120000_en

* Add model 2024-08-27-ocrerrs_en

* Add model 2024-08-27-kltn_coqe_vit5_total_sapol_test42_7_rs_northern_sami_pipeline_en

* Add model 2024-08-27-ocrerrs_pipeline_en

* Add model 2024-08-27-text_shortening_model_v70_en

* Add model 2024-08-27-text_shortening_model_v70_pipeline_en

* Add model 2024-08-27-t5_small_hotpot_qa_qg_en

* Add model 2024-08-27-mt5_small_finetuned_13feb_8_en

* Add model 2024-08-27-t5_small_hotpot_qa_qg_pipeline_en

* Add model 2024-08-27-mt5_small_finetuned_13feb_8_pipeline_en

* Add model 2024-08-27-mt5_small_trimmed_japanese_120000_pipeline_en

* Add model 2024-08-27-t5_60m_lm_wmt_2013_4_en

* Add model 2024-08-27-t5_60m_lm_wmt_2013_4_pipeline_en

* Add model 2024-08-27-mrpc_en

* Add model 2024-08-27-legal_t5_small_trans_czech_german_small_finetuned_en

* Add model 2024-08-27-mrpc_pipeline_en

* Add model 2024-08-27-legal_t5_small_trans_czech_german_small_finetuned_pipeline_en

* Add model 2024-08-27-t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_en

* Add model 2024-08-27-t5_small_finetuned_romanian_tonga_tonga_islands_english_danhsf_pipeline_en

* Add model 2024-08-27-lt5_large_en

* Add model 2024-08-27-t5_base_samsumgen_xsum_conv_samsum_seed42_en

* Add model 2024-08-27-lt5_large_pipeline_en

* Add model 2024-08-27-t5_base_samsumgen_xsum_conv_samsum_seed42_pipeline_en

* Add model 2024-08-27-flan_t5_base_poll_generation_en

* Add model 2024-08-27-m5_small_hindi_english_en

* Add model 2024-08-27-m5_small_hindi_english_pipeline_en

* Add model 2024-08-27-flan_t5_base_poll_generation_pipeline_en

* Add model 2024-08-27-bangla_idiom_translation_v1_en

* Add model 2024-08-27-mt5_small_squad_qg_trimmed_english_60000_en

* Add model 2024-08-27-mt5_small_squad_qg_trimmed_english_60000_pipeline_en

* Add model 2024-08-27-mt5_base_lit_simplif_en

* Add model 2024-08-27-flan_t5_cbp_lkg_alt_w_context_small_en

* Add model 2024-08-27-flan_t5_cbp_lkg_alt_w_context_small_pipeline_en

* Add model 2024-08-27-bangla_idiom_translation_v1_pipeline_en

* Add model 2024-08-27-mt5_base_lit_simplif_pipeline_en

* Add model 2024-08-27-burmese_awesome_billsum_model_parvathyip_en

* Add model 2024-08-27-burmese_awesome_billsum_model_parvathyip_pipeline_en

* Add model 2024-08-27-russian_t5_model_for_law_simplification_en

* Add model 2024-08-27-t5_base_title_pipeline_en

* Add model 2024-08-27-t5_base_title_en

* Add model 2024-08-27-russian_t5_model_for_law_simplification_pipeline_en

* Add model 2024-08-27-t5_base_c2_mare_ar1_ex8_half_2lrouter_en

* Add model 2024-08-27-t5_base_c2_mare_ar1_ex8_half_2lrouter_pipeline_en

* Add model 2024-08-27-derm_t5_small_1_en

* Add model 2024-08-27-mt5_small_finetuned_1_0_2_en

* Add model 2024-08-27-derm_t5_small_1_pipeline_en

* Add model 2024-08-27-mt5_small_finetuned_1_0_2_pipeline_en

* Add model 2024-08-27-salient_aiflan_t5_small_en

* Add model 2024-08-27-salient_aiflan_t5_small_pipeline_en

* Add model 2024-08-27-text_exps_t5_10_aug_en

* Add model 2024-08-27-english_mt5_base_10_wikisql_en

* Add model 2024-08-27-text_exps_t5_10_aug_pipeline_en

* Add model 2024-08-27-dialogue_summary_fine_tune_mem_test_en

* Add model 2024-08-27-dialogue_summary_fine_tune_mem_test_pipeline_en

* Add model 2024-08-27-t5_60m_lm_wmt_2021_2_en

* Add model 2024-08-27-cs505_coqe_vit5_train_instruction0_saopl_en

* Add model 2024-08-27-t5_60m_lm_wmt_2021_2_pipeline_en

* Add model 2024-08-27-kt_qa_generate_en

* Add model 2024-08-27-kt_qa_generate_pipeline_en

* Add model 2024-08-27-cs505_coqe_vit5_train_instruction0_saopl_pipeline_en

* Add model 2024-08-27-t5_small_finetuned_xsum_vigneshwar0803_en

* Add model 2024-08-27-t5_small_finetuned_xsum_vigneshwar0803_pipeline_en

* Add model 2024-08-27-mt5_small_trimmed_japanese_30000_jaquad_qa_ja

* Add model 2024-08-27-rut5_base_simple_aphasia_lvl1_en

* Add model 2024-08-27-legal_t5_small_summ_multitask_german_pipeline_en

* Add model 2024-08-27-rut5_base_simple_aphasia_lvl1_pipeline_en

* Add model 2024-08-27-legal_t5_small_summ_multitask_german_en

* Add model 2024-08-27-mt5_small_finetuned_amazon_english_spanish_shushantllm_en

* Add model 2024-08-27-mt5_small_itquad_qg_ae_trimmed_50000_en

* Add model 2024-08-27-mt5_small_finetuned_amazon_english_spanish_shushantllm_pipeline_en

* Add model 2024-08-27-mt5_small_itquad_qg_ae_trimmed_50000_pipeline_en

* Add model 2024-08-27-mt5_small_trimmed_japanese_30000_jaquad_qa_pipeline_ja

* Add model 2024-08-27-arat5_paraphrasing_en

* Add model 2024-08-27-mt5_small_finetuned_amazon_english_german_dlakeev_en

* Add model 2024-08-27-arat5_paraphrasing_pipeline_en

* Add model 2024-08-27-mt5_small_finetuned_amazon_english_german_dlakeev_pipeline_en

* Add model 2024-08-27-speller_t5_big_6_en

* Add model 2024-08-27-speller_t5_big_6_pipeline_en

* Add model 2024-08-27-flan_t5_large__multiple_choice_en

* Add model 2024-08-27-flan_t5_large__multiple_choice_pipeline_en

* Add model 2024-08-27-translation_test2_en

* Add model 2024-08-27-translation_test2_pipeline_en

* Add model 2024-08-27-qt5_small_en

* Add model 2024-08-27-qt5_small_pipeline_en

* Add model 2024-08-27-mt5_base_finetuned_onet_en

* Add model 2024-08-27-dsmlfinalproject_t5_en

* Add model 2024-08-27-dsmlfinalproject_t5_pipeline_en

* Add model 2024-08-27-mt5_base_60000_en

* Add model 2024-08-27-mt5_base_60000_pipeline_en

* Add model 2024-08-27-all_mt5_base_10_wikisql_en

* Add model 2024-08-27-all_mt5_base_10_wikisql_pipeline_en

* Add model 2024-08-27-long_t5_tglobal_large_multimedia_en

* Add model 2024-08-27-long_t5_tglobal_large_multimedia_pipeline_en

* Add model 2024-08-27-burmese_awesome_opus_books_modelllo_en

* Add model 2024-08-27-burmese_awesome_opus_books_modelllo_pipeline_en

* Add model 2024-08-27-t5_v1_1_base_gramatika_e8_b16_en

* Add model 2024-08-27-t5_v1_1_base_gramatika_e8_b16_pipeline_en

* Add model 2024-08-27-flan_t5_small_insight0_en

* Add model 2024-08-27-flan_t5_small_insight0_pipeline_en

* Add model 2024-08-27-all_mt5_base_15_spider_new2_en

* Add model 2024-08-27-t5_60m_lm_wmt_2012_1_en

* Add model 2024-08-27-t5_60m_lm_wmt_2012_1_pipeline_en

* Add model 2024-08-27-boolq_t5_small_seed_1_en

* Add model 2024-08-27-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_en

* Add model 2024-08-27-boolq_t5_small_seed_1_pipeline_en

* Add model 2024-08-27-shuffled_nodes_augmented_graphs_with_edge_document_level_t5_run2_pipeline_en

* Add model 2024-08-27-all_mt5_base_15_spider_new2_pipeline_en

* Add model 2024-08-27-autotrain_dlpeu_yhob0_en

* Add model 2024-08-27-autotrain_dlpeu_yhob0_pipeline_en

* Add model 2024-08-27-vit5_2048_gen512_pipeline_en

* Add model 2024-08-27-t5_small_qg_ctx_a_en

* Add model 2024-08-27-t5_small_qg_ctx_a_pipeline_en

* Add model 2024-08-27-normal_order_nodes_without_edge_label_sentence_level_t5_pipeline_en

* Add model 2024-08-27-normal_order_nodes_without_edge_label_sentence_level_t5_en

* Add model 2024-08-27-results2_pipeline_en

* Add model 2024-08-27-mt5_small_rabbi_kook_pipeline_en

* Add model 2024-08-27-mt5_small_rabbi_kook_en

* Add model 2024-08-27-results2_en

* Add model 2024-08-27-vit5_2048_gen512_en

* Add model 2024-08-27-sum_model_lr2e_3_20epoch_en

* Add model 2024-08-27-sum_model_lr2e_3_20epoch_pipeline_en

* Add model 2024-08-27-test_prod_exigent_t5_en

* Add model 2024-08-27-test_prod_exigent_t5_pipeline_en

* Add model 2024-08-27-bart_large_zero_shot_classifier_mnli_en

* Add model 2024-08-27-distilled_mt5_small_1b0000_en

* Add model 2024-08-27-distilled_mt5_small_1b0000_pipeline_en

* Add model 2024-08-27-grammar_corrector_v2_en

* Add model 2024-08-27-kinyarwanda_en

* Add model 2024-08-27-grammar_corrector_v2_pipeline_en

* Add model 2024-08-27-kinyarwanda_pipeline_en

* Add model 2024-08-27-svd_en

* Add model 2024-08-27-mt5_small_trimmed_japanese_120000_jaquad_qa_pipeline_ja

* Add model 2024-08-27-svd_pipeline_en

* Add model 2024-08-27-mt5_small_trimmed_japanese_120000_jaquad_qa_ja

* Add model 2024-08-27-cbt_flan_t5_model_3_en

* Add model 2024-08-27-cbt_flan_t5_model_3_pipeline_en

* Add model 2024-08-27-mt5_multitask_finetuned_en

* Add model 2024-08-27-t5_60m_lm_wmt_2013_10_en

* Add model 2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_en

* Add model 2024-08-27-t5_small_alpaca_en

* Add model 2024-08-27-t5_60m_lm_wmt_2013_10_pipeline_en

* Add model 2024-08-27-flan_t5_small_asap_t3_f0_punjabi_eastern_en

* Add model 2024-08-27-t5_small_alpaca_pipeline_en

* Add model 2024-08-27-mt5_small_squad_qa_trimmed_english_60000_en

* Add model 2024-08-27-t5_finetune_cnndaily_news_sumsum_minddigger008_en

* Add model 2024-08-27-mt5_small_finetuned_amazon_english_spanish_tzurvaich_pipeline_en

* Add model 2024-08-27-mt5_small_finetuned_amazon_english_spanish_tzurvaich_en

* Add model 2024-08-27-longt5_tglobal_base_scipaper_pipeline_en

* Add model 2024-08-27-longt5_tglobal_base_scipaper_en

* Add model 2024-08-27-flan_t5_small_asap_t3_f0_punjabi_eastern_pipeline_en

* Add model 2024-08-27-t5_finetune_cnndaily_news_sumsum_minddigger008_pipeline_en

* Add model 2024-08-27-shuffled_nodes_normal_graphs_with_edge_document_level_t5_run2_pipeline_en

* Add model 2024-08-27-mt5_small_squad_qa_trimmed_english_60000_pipeline_en

* Add model 2024-08-27-formal_tonga_tonga_islands_informal_pipeline_en

* Add model 2024-08-27-t5_dialogue_classification_3_kmanaa_pipeline_en

* Add model 2024-08-27-kltn_coqe_vit5_total_poasl_v4_en

* Add model 2024-08-27-flan_t5_tacred_kongo_mlm_small_pipeline_en

* Add model 2024-08-27-kltn_coqe_vit5_total_poasl_v4_pipeline_en

* Add model 2024-08-27-flan_t5_tacred_kongo_mlm_small_en

* Add model 2024-08-27-t5_dialogue_classification_3_kmanaa_en

* Add model 2024-08-27-bart_large_zero_shot_classifier_mnli_en

* Add model 2024-08-27-speller_t5_big_3_pipeline_en

* Add model 2024-08-27-formal_tonga_tonga_islands_informal_en

* Add model 2024-08-27-cs505_coqe_vit5_train_instruction0_oaspl_en

* Add model 2024-08-27-cs505_coqe_vit5_train_instruction0_oaspl_pipeline_en

* Add model 2024-08-27-speller_t5_big_3_en

* Add model 2024-08-27-flan_t5_retacred_all_kongo_small_en

* Add model 2024-08-27-flan_t5_retacred_all_kongo_small_pipeline_en

* Add model 2024-08-27-mt5_base_finetuned_notes_summaries_en

* Add model 2024-08-27-t5_large_readme_summarization_en

* Add model 2024-08-27-imdb_t5_large_seed_1_en

---------

Co-authored-by: ahmedlone127 <ahmedlone127@gmail.com>
  • Loading branch information
jsl-models and ahmedlone127 authored Aug 27, 2024
1 parent 32d8591 commit 784ce75
Show file tree
Hide file tree
Showing 3,643 changed files with 283,146 additions and 0 deletions.
The diff you're trying to view is too large. We only load the first 3000 changed files.
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
---
layout: model
title: English 0417_t5_baseline_checkpoint_9500 T5Transformer from Luluuu
author: John Snow Labs
name: 0417_t5_baseline_checkpoint_9500
date: 2024-08-23
tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
engine: onnx
annotator: T5Transformer
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`0417_t5_baseline_checkpoint_9500` is a English model originally trained by Luluuu.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/0417_t5_baseline_checkpoint_9500_en_5.4.2_3.0_1724453926632.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/0417_t5_baseline_checkpoint_9500_en_5.4.2_3.0_1724453926632.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

documentAssembler = DocumentAssembler() \
.setInputCol('text') \
.setOutputCol('document')

t5 = T5Transformer.pretrained("0417_t5_baseline_checkpoint_9500","en") \
.setInputCols(["document"]) \
.setOutputCol("output")

pipeline = Pipeline().setStages([documentAssembler, t5])
data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text")
pipelineModel = pipeline.fit(data)
pipelineDF = pipelineModel.transform(data)

```
```scala

val documentAssembler = new DocumentAssembler()
.setInputCols("text")
.setOutputCols("document")

val t5 = T5Transformer.pretrained("0417_t5_baseline_checkpoint_9500", "en")
.setInputCols(Array("documents"))
.setOutputCol("output")

val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
val data = Seq("I love spark-nlp").toDS.toDF("text")
val pipelineModel = pipeline.fit(data)
val pipelineDF = pipelineModel.transform(data)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|0417_t5_baseline_checkpoint_9500|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Input Labels:|[document]|
|Output Labels:|[output]|
|Language:|en|
|Size:|3.0 GB|

## References

https://huggingface.co/Luluuu/0417_T5_baseline_checkpoint_9500
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
---
layout: model
title: English 0417_t5_baseline_checkpoint_9500_pipeline pipeline T5Transformer from Luluuu
author: John Snow Labs
name: 0417_t5_baseline_checkpoint_9500_pipeline
date: 2024-08-23
tags: [en, open_source, pipeline, onnx]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
annotator: PipelineModel
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`0417_t5_baseline_checkpoint_9500_pipeline` is a English model originally trained by Luluuu.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/0417_t5_baseline_checkpoint_9500_pipeline_en_5.4.2_3.0_1724454072827.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/0417_t5_baseline_checkpoint_9500_pipeline_en_5.4.2_3.0_1724454072827.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

pipeline = PretrainedPipeline("0417_t5_baseline_checkpoint_9500_pipeline", lang = "en")
annotations = pipeline.transform(df)

```
```scala

val pipeline = new PretrainedPipeline("0417_t5_baseline_checkpoint_9500_pipeline", lang = "en")
val annotations = pipeline.transform(df)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|0417_t5_baseline_checkpoint_9500_pipeline|
|Type:|pipeline|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Language:|en|
|Size:|3.0 GB|

## References

https://huggingface.co/Luluuu/0417_T5_baseline_checkpoint_9500

## Included Models

- DocumentAssembler
- T5Transformer
86 changes: 86 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-23-20240223_8_en.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
---
layout: model
title: English 20240223_8 T5Transformer from picas9dan
author: John Snow Labs
name: 20240223_8
date: 2024-08-23
tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
engine: onnx
annotator: T5Transformer
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240223_8` is a English model originally trained by picas9dan.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240223_8_en_5.4.2_3.0_1724410584140.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240223_8_en_5.4.2_3.0_1724410584140.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

documentAssembler = DocumentAssembler() \
.setInputCol('text') \
.setOutputCol('document')

t5 = T5Transformer.pretrained("20240223_8","en") \
.setInputCols(["document"]) \
.setOutputCol("output")

pipeline = Pipeline().setStages([documentAssembler, t5])
data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text")
pipelineModel = pipeline.fit(data)
pipelineDF = pipelineModel.transform(data)

```
```scala

val documentAssembler = new DocumentAssembler()
.setInputCols("text")
.setOutputCols("document")

val t5 = T5Transformer.pretrained("20240223_8", "en")
.setInputCols(Array("documents"))
.setOutputCol("output")

val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
val data = Seq("I love spark-nlp").toDS.toDF("text")
val pipelineModel = pipeline.fit(data)
val pipelineDF = pipelineModel.transform(data)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|20240223_8|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Input Labels:|[document]|
|Output Labels:|[output]|
|Language:|en|
|Size:|3.1 GB|

## References

https://huggingface.co/picas9dan/20240223_8
69 changes: 69 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-23-20240223_8_pipeline_en.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
---
layout: model
title: English 20240223_8_pipeline pipeline T5Transformer from picas9dan
author: John Snow Labs
name: 20240223_8_pipeline
date: 2024-08-23
tags: [en, open_source, pipeline, onnx]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
annotator: PipelineModel
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20240223_8_pipeline` is a English model originally trained by picas9dan.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20240223_8_pipeline_en_5.4.2_3.0_1724410728536.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20240223_8_pipeline_en_5.4.2_3.0_1724410728536.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

pipeline = PretrainedPipeline("20240223_8_pipeline", lang = "en")
annotations = pipeline.transform(df)

```
```scala

val pipeline = new PretrainedPipeline("20240223_8_pipeline", lang = "en")
val annotations = pipeline.transform(df)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|20240223_8_pipeline|
|Type:|pipeline|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Language:|en|
|Size:|3.1 GB|

## References

https://huggingface.co/picas9dan/20240223_8

## Included Models

- DocumentAssembler
- T5Transformer
Loading

0 comments on commit 784ce75

Please sign in to comment.