Skip to content

Commit

Permalink
2024-08-12-flan_t5_base_tweet_hate_en (#14366)
Browse files Browse the repository at this point in the history
* Add model 2024-08-12-keybert_absa_hospital_multilingual_allenai_turkmen_instruct_base_def_sayula_popoluca_finedtuned_model_pipeline_xx

* Add model 2024-08-12-t5_60m_lm_wmt_2014_11_en

* Add model 2024-08-12-results_omarmedhatt_en

* Add model 2024-08-12-t5_60m_lm_wmt_2014_11_pipeline_en

* Add model 2024-08-12-results_omarmedhatt_pipeline_en

* Add model 2024-08-12-flan_t5_continuity_rephrase_v2_0_en

* Add model 2024-08-12-t5_base_finetuned_spanish_tonga_tonga_islands_ngu_en

* Add model 2024-08-12-city_council_gpt3_silver_standard_summaries__long_t5_local_base_en

* Add model 2024-08-12-city_council_gpt3_silver_standard_summaries__long_t5_local_base_pipeline_en

* Add model 2024-08-12-t5_base_finetuned_spanish_tonga_tonga_islands_ngu_pipeline_en

* Add model 2024-08-12-ul2_small_dutch_finetuned_squad_qgen_pipeline_en

* Add model 2024-08-12-flan_t5_small_3_6_cnndm_pipeline_en

* Add model 2024-08-12-t5large_trec_coarse_style_1_en

* Add model 2024-08-12-t5large_trec_coarse_style_1_pipeline_en

* Add model 2024-08-12-ul2_small_dutch_finetuned_squad_qgen_en

* Add model 2024-08-12-flan_t5_continuity_rephrase_v2_0_pipeline_en

* Add model 2024-08-12-t5_60m_lm_wmt_2012_6_en

* Add model 2024-08-12-t5_60m_lm_wmt_2012_6_pipeline_en

* Add model 2024-08-12-flan_t5_small_3_6_cnndm_en

* Add model 2024-08-12-t5_large_jaimin_en

* Add model 2024-08-12-t5_small_scan_finetuned_yoon_1026_en

* Add model 2024-08-12-t5_small_scan_finetuned_yoon_1026_pipeline_en

* Add model 2024-08-12-t5_large_jaimin_pipeline_en

* Add model 2024-08-12-test_t5_qplus_base_en

* Add model 2024-08-12-cs505_coqe_vit5_prompting5_aspol_vcheck_en

* Add model 2024-08-12-test_t5_qplus_base_pipeline_en

* Add model 2024-08-12-cs505_coqe_vit5_prompting5_aspol_vcheck_pipeline_en

* Add model 2024-08-12-t5_60m_lm_wmt_2020_1_en

* Add model 2024-08-12-wmt22_english_portuguese_breton_en

* Add model 2024-08-12-t5_60m_lm_wmt_2020_1_pipeline_en

* Add model 2024-08-12-wmt22_english_portuguese_breton_pipeline_en

* Add model 2024-08-12-mt5_small_scientific_title_maker_en

* Add model 2024-08-12-burmese_awesome_opus_books_model_2_rabby33_en

* Add model 2024-08-12-mt5_small_scientific_title_maker_pipeline_en

* Add model 2024-08-12-t5_small_xsum_kssteven_en

* Add model 2024-08-12-burmese_awesome_opus_books_model_2_rabby33_pipeline_en

* Add model 2024-08-12-flan_t5_base_tweet_similarity_pipeline_en

* Add model 2024-08-12-t5_small_xsum_kssteven_pipeline_en

* Add model 2024-08-12-falconsai_t5_small_pretrained_text_summarization_samsum_en

* Add model 2024-08-12-flan_t5_base_tweet_similarity_en

* Add model 2024-08-12-falconsai_t5_small_pretrained_text_summarization_samsum_pipeline_en

* Add model 2024-08-12-mt5_small_tibetan_standard_10k_en

* Add model 2024-08-12-mt5_small_koquad_qa_trimmed_korean_10000_en

* Add model 2024-08-12-mt5_small_koquad_qa_trimmed_korean_10000_pipeline_en

* Add model 2024-08-12-mt5_small_tibetan_standard_10k_pipeline_en

* Add model 2024-08-12-t5_small_finetune_dzongkha_tonga_tonga_islands_romanized_en

* Add model 2024-08-12-t5_small_finetune_dzongkha_tonga_tonga_islands_romanized_pipeline_en

* Add model 2024-08-12-t5_large_dataset_radiology_summary20221129_tsv_en

* Add model 2024-08-12-t5_large_dataset_radiology_summary20221129_tsv_pipeline_en

* Add model 2024-08-12-lit5_small_en

* Add model 2024-08-12-t5_recommendation_sports_equipment_en

* Add model 2024-08-12-mt5_small_squad_qa_en

* Add model 2024-08-12-mt5_small_squad_qa_pipeline_en

* Add model 2024-08-12-t5_recommendation_sports_equipment_pipeline_en

* Add model 2024-08-12-distilled_mt5_small_hiddentest_en

* Add model 2024-08-12-lit5_small_pipeline_en

* Add model 2024-08-12-cs505_coqe_vit5_prompting1_aspol_en

* Add model 2024-08-12-distilled_mt5_small_hiddentest_pipeline_en

* Add model 2024-08-12-cs505_coqe_vit5_prompting1_aspol_pipeline_en

* Add model 2024-08-12-summary_end2end_questions_generation_en

* Add model 2024-08-12-qa_en

* Add model 2024-08-12-summary_end2end_questions_generation_pipeline_en

* Add model 2024-08-12-qa_pipeline_en

* Add model 2024-08-12-long_t5_tglobal_base_16384_book_summary_finetuned_xsum_en

* Add model 2024-08-12-t5_60m_lm_wmt_2014_2_pipeline_en

* Add model 2024-08-12-t5_base_subjqa_vanilla_books_qg_pipeline_en

* Add model 2024-08-12-t5_60m_lm_wmt_2014_2_en

* Add model 2024-08-12-long_t5_tglobal_base_16384_book_summary_finetuned_xsum_pipeline_en

* Add model 2024-08-12-flan_t5_base_finetuned_xsum_brutusxu_pipeline_en

* Add model 2024-08-12-flan_t5_base_finetuned_xsum_brutusxu_en

* Add model 2024-08-12-t5_base_subjqa_vanilla_books_qg_en

* Add model 2024-08-12-t5_small_cnndm_bild_aligned_pipeline_en

* Add model 2024-08-12-t5_small_cnndm_bild_aligned_en

* Add model 2024-08-12-t5_finetuned_xsum_salvatore_pipeline_en

* Add model 2024-08-12-autonlp_mt5_xlsum_25085641_en

* Add model 2024-08-12-finetune_extractive_qa_t5_tiny_standard_bahasa_cased_en

* Add model 2024-08-12-finetune_extractive_qa_t5_tiny_standard_bahasa_cased_pipeline_en

* Add model 2024-08-12-autonlp_mt5_xlsum_25085641_pipeline_en

* Add model 2024-08-12-t5_60m_poli_aff_2018_11_en

* Add model 2024-08-12-t5_60m_poli_aff_2018_11_pipeline_en

* Add model 2024-08-12-t5_finetuned_xsum_salvatore_en

* Add model 2024-08-12-t5_60m_poli_aff_2015_5_en

* Add model 2024-08-12-t5_60m_poli_aff_2015_5_pipeline_en

* Add model 2024-08-12-t5_base_paopow_en

* Add model 2024-08-12-teabreac_preasm_large_drop_en

* Add model 2024-08-12-t5_small_french_finetuned_english_tonga_tonga_islands_italian_en

* Add model 2024-08-12-t5_base_paopow_pipeline_en

* Add model 2024-08-12-t5_small_french_finetuned_english_tonga_tonga_islands_italian_pipeline_en

* Add model 2024-08-12-teabreac_preasm_large_drop_pipeline_en

* Add model 2024-08-12-flan_t5_base_master_case_pipeline_en

* Add model 2024-08-12-flan_t5_base_master_case_en

* Add model 2024-08-12-t5_small_finetuned_xsum_chhabi_en

* Add model 2024-08-12-t5_small_finetuned_xsum_chhabi_pipeline_en

* Add model 2024-08-12-real_promptv3_all_gen_t5_small_en

* Add model 2024-08-12-flan_t5_base_squda_fine_tune_qs_en

* Add model 2024-08-12-real_promptv3_all_gen_t5_small_pipeline_en

* Add model 2024-08-12-flan_t5_base_squda_fine_tune_qs_pipeline_en

* Add model 2024-08-12-t5_c4_200m_15k_en

* Add model 2024-08-12-t5_base_squadshifts_reddit_qg_pipeline_en

* Add model 2024-08-12-t5_base_squadshifts_reddit_qg_en

* Add model 2024-08-12-flant5_mix_en

* Add model 2024-08-12-flant5_mix_pipeline_en

* Add model 2024-08-12-eng2sans_en

* Add model 2024-08-12-eng2sans_pipeline_en

* Add model 2024-08-12-t5_base_ayon128_en

* Add model 2024-08-12-t5_c4_200m_15k_pipeline_en

* Add model 2024-08-12-t5_small_finetuned_xsum_honganhle1903_en

* Add model 2024-08-12-t5_base_ayon128_pipeline_en

* Add model 2024-08-12-mt5_small_finetuned_amazon_english_spanish_bnorth_en

* Add model 2024-08-12-t5_small_finetuned_xsum_honganhle1903_pipeline_en

* Add model 2024-08-12-mt5_small_finetuned_amazon_english_spanish_bnorth_pipeline_en

* Add model 2024-08-12-error_diagnostic_model_japaneset5_en

* Add model 2024-08-12-error_diagnostic_model_japaneset5_pipeline_en

* Add model 2024-08-12-t5_small_finetuned_hellonew2811_en

* Add model 2024-08-12-t5_small_finetuned_hellonew2811_pipeline_en

* Add model 2024-08-12-mt5_small_esquad_qg_trimmed_spanish_30000_en

* Add model 2024-08-12-t5_small_finetuned_amazon_english_french_en

* Add model 2024-08-12-mt5_small_esquad_qg_trimmed_spanish_30000_pipeline_en

* Add model 2024-08-12-t5_small_finetuned_amazon_english_french_pipeline_en

* Add model 2024-08-12-comp561final_en

* Add model 2024-08-12-comp561final_pipeline_en

* Add model 2024-08-12-t5_60m_lm_wmt_2021_10_en

* Add model 2024-08-12-t5_60m_lm_wmt_2021_10_pipeline_en

* Add model 2024-08-12-mt5_danish_base_en

* Add model 2024-08-12-cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_f2_en

* Add model 2024-08-12-mt5_danish_base_pipeline_en

* Add model 2024-08-12-cs505_coqe_vit5_prompting5_apsol_gpt_t3vslabel2t5_f2_pipeline_en

* Add model 2024-08-12-t5_base_tedxjp_0front_1body_5rear_order_rb_en

* Add model 2024-08-12-t5_base_tedxjp_0front_1body_5rear_order_rb_pipeline_en

* Add model 2024-08-12-lt5_base_en

* Add model 2024-08-12-lt5_base_pipeline_en

* Add model 2024-08-12-long_t5_tglobal_base_multinews_en

* Add model 2024-08-12-banglat5_finetuned_headlinebt5_1000_batch8_en

* Add model 2024-08-12-flan_t5_base_danish_multiwoz2_0_80_loss_ep100_en

* Add model 2024-08-12-long_t5_tglobal_base_multinews_pipeline_en

* Add model 2024-08-12-flan_t5_base_danish_multiwoz2_0_80_loss_ep100_pipeline_en

* Add model 2024-08-12-t5_acled_ie_pipeline_en

* Add model 2024-08-12-t5_base_analogy_en

* Add model 2024-08-12-t5_base_analogy_pipeline_en

* Add model 2024-08-12-banglat5_finetuned_headlinebt5_1000_batch8_pipeline_en

* Add model 2024-08-12-t5_rebuilder_pipeline_en

* Add model 2024-08-12-flan_t5_small_yake_top3_asks_qg_en

* Add model 2024-08-12-flan_t5_small_yake_top3_asks_qg_pipeline_en

* Add model 2024-08-12-t5_rebuilder_en

* Add model 2024-08-12-text_exps_t5_large_20_aug_en

* Add model 2024-08-12-t5_base_fin_1_en

* Add model 2024-08-12-t5_base_fin_1_pipeline_en

* Add model 2024-08-12-text_exps_t5_large_20_aug_pipeline_en

* Add model 2024-08-12-t5_small_finetuned_xsum_ecordova06_en

* Add model 2024-08-12-t5_small_finetuned_xsum_ecordova06_pipeline_en

* Add model 2024-08-12-mt5_small_finetuned_amazon_english_spanish_wwells_en

* Add model 2024-08-13-mt5_small_finetuned_amazon_english_spanish_wwells_pipeline_en

* Add model 2024-08-13-t5_v1_1_large_fce_e8_b16_en

* Add model 2024-08-13-t5_60m_lm_wmt_2016_4_en

* Add model 2024-08-13-t5_small_finetuned_wikisql_job6742_en

* Add model 2024-08-13-t5_60m_lm_wmt_2016_4_pipeline_en

* Add model 2024-08-13-t5_small_finetuned_wikisql_job6742_pipeline_en

* Add model 2024-08-13-google_mt5_base_deysi_traduction_chinese_sp_es

* Add model 2024-08-13-google_mt5_base_deysi_traduction_chinese_sp_pipeline_es

* Add model 2024-08-13-exp_two_ep_en

* Add model 2024-08-13-exp_two_ep_pipeline_en

* Add model 2024-08-13-nt5_small_tatqa_en

* Add model 2024-08-13-nt5_small_tatqa_pipeline_en

* Add model 2024-08-13-t5large_sst2_bible_adv_instruction_1_en

* Add model 2024-08-13-t5large_sst2_bible_adv_instruction_1_pipeline_en

* Add model 2024-08-13-t5paraphase_finetuned_en

* Add model 2024-08-13-viet_model_en

* Add model 2024-08-13-t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_yes_paragraph_2_en

* Add model 2024-08-13-t5paraphase_finetuned_pipeline_en

* Add model 2024-08-13-t5_small_finetuned_norwegian_paragraph_tonga_tonga_islands_yes_paragraph_2_pipeline_en

* Add model 2024-08-13-viet_model_pipeline_en

* Add model 2024-08-13-flan_t5_large_medistill_28_rougeave_en

* Add model 2024-08-13-mt5_base_finetuned_latin_serbian_summarizer_en

* Add model 2024-08-13-flan_t5_large_medistill_28_rougeave_pipeline_en

* Add model 2024-08-13-mt5_base_finetuned_latin_serbian_summarizer_pipeline_en

* Add model 2024-08-13-t5_small_with_generate_finetune_indosum_en

* Add model 2024-08-13-ll_seq2seq_en

* Add model 2024-08-13-ll_seq2seq_pipeline_en

* Add model 2024-08-13-t5_v1_1_small_mbay_translation_en

* Add model 2024-08-13-flan_t5_base_squad_qg_tarek23_en

* Add model 2024-08-13-yelp_polarity_t5_small_seed_3_en

* Add model 2024-08-13-mt5_small_trimmed_spanish_15000_esquad_qg_es

* Add model 2024-08-13-yelp_polarity_t5_small_seed_3_pipeline_en

* Add model 2024-08-13-t5_small_finetuned_policy_en

* Add model 2024-08-13-t5_small_with_generate_finetune_indosum_pipeline_en

* Add model 2024-08-13-mt5_small_itquad_qa_trimmed_italian_en

* Add model 2024-08-13-nlp_a3_2c_en

* Add model 2024-08-13-nlp_a3_2c_pipeline_en

* Add model 2024-08-13-t5_v1_1_small_mbay_translation_pipeline_en

* Add model 2024-08-13-mt5_small_itquad_qa_trimmed_italian_pipeline_en

* Add model 2024-08-13-mt5_small_kde4_english_korean_en

* Add model 2024-08-13-mt5_small_trimmed_spanish_15000_esquad_qg_pipeline_es

* Add model 2024-08-13-flan_t5_base_squad_qg_tarek23_pipeline_en

* Add model 2024-08-13-t5_small_inglish_en

* Add model 2024-08-13-t5_small_inglish_pipeline_en

* Add model 2024-08-13-mt5_small_kde4_english_korean_pipeline_en

* Add model 2024-08-13-t5_small_finetuned_policy_pipeline_en

* Add model 2024-08-13-mt5_small_croatian_10k_en

* Add model 2024-08-13-mt5_small_dutch_10k_en

* Add model 2024-08-13-mt5_base_finetuned_nepali_health_en

* Add model 2024-08-13-mt5_small_croatian_10k_pipeline_en

* Add model 2024-08-13-mt5_small_dutch_10k_pipeline_en

* Add model 2024-08-13-speller_t5_en

* Add model 2024-08-13-mt5_base_finetuned_nepali_health_pipeline_en

* Add model 2024-08-13-flan_t5_tacred_kongo_small_en

* Add model 2024-08-13-speller_t5_pipeline_en

* Add model 2024-08-13-results_shrunoti09_en

* Add model 2024-08-13-t5_small_squad_qg_a2c_spt_valid_pipeline_en

* Add model 2024-08-13-flan_t5_tacred_kongo_small_pipeline_en

* Add model 2024-08-13-t5_small_squad_qg_a2c_spt_valid_en

* Add model 2024-08-13-results_shrunoti09_pipeline_en

* Add model 2024-08-13-t5_base_pointer_adv_cstop_artificial_en

* Add model 2024-08-13-t5_title_g_b_pipeline_en

* Add model 2024-08-13-t5_title_g_b_en

* Add model 2024-08-13-t5_base_pointer_adv_cstop_artificial_pipeline_en

* Add model 2024-08-13-cs505_coqe_vit5_total_instruction4_aspol_v1_en

* Add model 2024-08-13-cs505_coqe_vit5_total_instruction4_aspol_v1_pipeline_en

* Add model 2024-08-13-t5_60m_poli_aff_2018_5_en

* Add model 2024-08-13-speller_t5_big_2_en

* Add model 2024-08-13-t5_60m_poli_aff_2018_5_pipeline_en

* Add model 2024-08-13-speller_t5_big_2_pipeline_en

* Add model 2024-08-13-vit5_anhdt_dsai_02_en

* Add model 2024-08-13-burmese_awesome_billsum_model_abymmathew_pipeline_en

* Add model 2024-08-13-squad_bengali_qgen_mt5_all_metric_en

* Add model 2024-08-13-vit5_anhdt_dsai_02_pipeline_en

* Add model 2024-08-13-t5_small_indonesia_summarization_en

* Add model 2024-08-13-t5_small_indonesia_summarization_pipeline_en

* Add model 2024-08-13-flan_t5_small_finetuned_il_post_italian_en

* Add model 2024-08-13-flan_t5_small_finetuned_il_post_italian_pipeline_en

* Add model 2024-08-13-t5_left_commands_tonga_tonga_islands_actions_5_en

* Add model 2024-08-13-burmese_awesome_billsum_model_abymmathew_en

* Add model 2024-08-13-t5_left_commands_tonga_tonga_islands_actions_5_pipeline_en

* Add model 2024-08-13-squad_bengali_qgen_mt5_all_metric_pipeline_en

* Add model 2024-08-13-mt5meu600_pipeline_en

* Add model 2024-08-13-mt5meu600_en

* Add model 2024-08-13-mt5_small_finetuned_nepali_health_ii_pipeline_en

* Add model 2024-08-13-flan_t5_budget_seq_en

* Add model 2024-08-13-t5_small_finetuned_english_tonga_tonga_islands_bash_josh98_en

* Add model 2024-08-13-flan_t5_budget_seq_pipeline_en

* Add model 2024-08-13-t5_small_finetuned_english_tonga_tonga_islands_bash_josh98_pipeline_en

* Add model 2024-08-13-snli_t5_large_seed_3_en

* Add model 2024-08-13-snli_t5_large_seed_3_pipeline_en

* Add model 2024-08-13-t5_pretrain_final_final_final_final_en

* Add model 2024-08-13-t5_pretrain_final_final_final_final_pipeline_en

* Add model 2024-08-13-t5_v1_1_small_caption2smiles_ft_from_pretrained_c4_en

* Add model 2024-08-13-t5_v1_1_small_caption2smiles_ft_from_pretrained_c4_pipeline_en

* Add model 2024-08-13-kaggle_freezed_english_german_en

* Add model 2024-08-13-kaggle_freezed_english_german_pipeline_en

* Add model 2024-08-13-mt5_small_kyrgyz_10k_en

---------

Co-authored-by: ahmedlone127 <ahmedlone127@gmail.com>
Co-authored-by: Maziyar Panahi <maziyar.panahi@iscpif.fr>
  • Loading branch information
3 people authored Aug 15, 2024
1 parent b7047c6 commit 962d9e0
Show file tree
Hide file tree
Showing 355 changed files with 27,521 additions and 0 deletions.
86 changes: 86 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-12-20231130_1_en.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
---
layout: model
title: English 20231130_1 T5Transformer from picas9dan
author: John Snow Labs
name: 20231130_1
date: 2024-08-12
tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
engine: onnx
annotator: T5Transformer
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_1` is a English model originally trained by picas9dan.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_1_en_5.4.2_3.0_1723493688983.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_1_en_5.4.2_3.0_1723493688983.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

documentAssembler = DocumentAssembler() \
.setInputCol('text') \
.setOutputCol('document')

t5 = T5Transformer.pretrained("20231130_1","en") \
.setInputCols(["document"]) \
.setOutputCol("output")

pipeline = Pipeline().setStages([documentAssembler, t5])
data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text")
pipelineModel = pipeline.fit(data)
pipelineDF = pipelineModel.transform(data)

```
```scala

val documentAssembler = new DocumentAssembler()
.setInputCols("text")
.setOutputCols("document")

val t5 = T5Transformer.pretrained("20231130_1", "en")
.setInputCols(Array("documents"))
.setOutputCol("output")

val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
val data = Seq("I love spark-nlp").toDS.toDF("text")
val pipelineModel = pipeline.fit(data)
val pipelineDF = pipelineModel.transform(data)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|20231130_1|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Input Labels:|[document]|
|Output Labels:|[output]|
|Language:|en|
|Size:|1.0 GB|

## References

https://huggingface.co/picas9dan/20231130_1
69 changes: 69 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-12-20231130_1_pipeline_en.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
---
layout: model
title: English 20231130_1_pipeline pipeline T5Transformer from picas9dan
author: John Snow Labs
name: 20231130_1_pipeline
date: 2024-08-12
tags: [en, open_source, pipeline, onnx]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
annotator: PipelineModel
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`20231130_1_pipeline` is a English model originally trained by picas9dan.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/20231130_1_pipeline_en_5.4.2_3.0_1723493734054.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/20231130_1_pipeline_en_5.4.2_3.0_1723493734054.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

pipeline = PretrainedPipeline("20231130_1_pipeline", lang = "en")
annotations = pipeline.transform(df)

```
```scala

val pipeline = new PretrainedPipeline("20231130_1_pipeline", lang = "en")
val annotations = pipeline.transform(df)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|20231130_1_pipeline|
|Type:|pipeline|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Language:|en|
|Size:|1.0 GB|

## References

https://huggingface.co/picas9dan/20231130_1

## Included Models

- DocumentAssembler
- T5Transformer
86 changes: 86 additions & 0 deletions docs/_posts/ahmedlone127/2024-08-12-5kg3_3nmr_tqme_0_en.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,86 @@
---
layout: model
title: English 5kg3_3nmr_tqme_0 T5Transformer from GabrielG3
author: John Snow Labs
name: 5kg3_3nmr_tqme_0
date: 2024-08-12
tags: [en, open_source, onnx, t5, question_answering, summarization, translation, text_generation]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
engine: onnx
annotator: T5Transformer
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer model, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`5kg3_3nmr_tqme_0` is a English model originally trained by GabrielG3.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/5kg3_3nmr_tqme_0_en_5.4.2_3.0_1723489969161.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/5kg3_3nmr_tqme_0_en_5.4.2_3.0_1723489969161.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

documentAssembler = DocumentAssembler() \
.setInputCol('text') \
.setOutputCol('document')

t5 = T5Transformer.pretrained("5kg3_3nmr_tqme_0","en") \
.setInputCols(["document"]) \
.setOutputCol("output")

pipeline = Pipeline().setStages([documentAssembler, t5])
data = spark.createDataFrame([["I love spark-nlp"]]).toDF("text")
pipelineModel = pipeline.fit(data)
pipelineDF = pipelineModel.transform(data)

```
```scala

val documentAssembler = new DocumentAssembler()
.setInputCols("text")
.setOutputCols("document")

val t5 = T5Transformer.pretrained("5kg3_3nmr_tqme_0", "en")
.setInputCols(Array("documents"))
.setOutputCol("output")

val pipeline = new Pipeline().setStages(Array(documentAssembler, t5))
val data = Seq("I love spark-nlp").toDS.toDF("text")
val pipelineModel = pipeline.fit(data)
val pipelineDF = pipelineModel.transform(data)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|5kg3_3nmr_tqme_0|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Input Labels:|[document]|
|Output Labels:|[output]|
|Language:|en|
|Size:|318.9 MB|

## References

https://huggingface.co/GabrielG3/5kg3-3nmr-tqme-0
Original file line number Diff line number Diff line change
@@ -0,0 +1,69 @@
---
layout: model
title: English 5kg3_3nmr_tqme_0_pipeline pipeline T5Transformer from GabrielG3
author: John Snow Labs
name: 5kg3_3nmr_tqme_0_pipeline
date: 2024-08-12
tags: [en, open_source, pipeline, onnx]
task: [Question Answering, Summarization, Translation, Text Generation]
language: en
edition: Spark NLP 5.4.2
spark_version: 3.0
supported: true
annotator: PipelineModel
article_header:
type: cover
use_language_switcher: "Python-Scala-Java"
---

## Description

Pretrained T5Transformer, adapted from Hugging Face and curated to provide scalability and production-readiness using Spark NLP.`5kg3_3nmr_tqme_0_pipeline` is a English model originally trained by GabrielG3.

{:.btn-box}
<button class="button button-orange" disabled>Live Demo</button>
<button class="button button-orange" disabled>Open in Colab</button>
[Download](https://s3.amazonaws.com/auxdata.johnsnowlabs.com/public/models/5kg3_3nmr_tqme_0_pipeline_en_5.4.2_3.0_1723489997631.zip){:.button.button-orange.button-orange-trans.arr.button-icon}
[Copy S3 URI](s3://auxdata.johnsnowlabs.com/public/models/5kg3_3nmr_tqme_0_pipeline_en_5.4.2_3.0_1723489997631.zip){:.button.button-orange.button-orange-trans.button-icon.button-copy-s3}

## How to use



<div class="tabs-box" markdown="1">
{% include programmingLanguageSelectScalaPythonNLU.html %}
```python

pipeline = PretrainedPipeline("5kg3_3nmr_tqme_0_pipeline", lang = "en")
annotations = pipeline.transform(df)

```
```scala

val pipeline = new PretrainedPipeline("5kg3_3nmr_tqme_0_pipeline", lang = "en")
val annotations = pipeline.transform(df)

```
</div>

{:.model-param}
## Model Information

{:.table-model}
|---|---|
|Model Name:|5kg3_3nmr_tqme_0_pipeline|
|Type:|pipeline|
|Compatibility:|Spark NLP 5.4.2+|
|License:|Open Source|
|Edition:|Official|
|Language:|en|
|Size:|318.9 MB|

## References

https://huggingface.co/GabrielG3/5kg3-3nmr-tqme-0

## Included Models

- DocumentAssembler
- T5Transformer
Loading

0 comments on commit 962d9e0

Please sign in to comment.