diff --git a/docs/assets/images/Classify_Alcohol_Status.svg b/docs/assets/images/Classify_Alcohol_Status.svg
new file mode 100644
index 00000000000000..16fe191f217245
--- /dev/null
+++ b/docs/assets/images/Classify_Alcohol_Status.svg
@@ -0,0 +1 @@
+
\ No newline at end of file
diff --git a/docs/assets/images/Classify_Tobacco_Consumption.svg b/docs/assets/images/Classify_Tobacco_Consumption.svg
new file mode 100644
index 00000000000000..f31bd4bc75fdb5
--- /dev/null
+++ b/docs/assets/images/Classify_Tobacco_Consumption.svg
@@ -0,0 +1 @@
+
\ No newline at end of file
diff --git a/docs/assets/images/Detect_Available_Pretrained_NER_Models.svg b/docs/assets/images/Detect_Available_Pretrained_NER_Models.svg
new file mode 100644
index 00000000000000..3e67bac1efced4
--- /dev/null
+++ b/docs/assets/images/Detect_Available_Pretrained_NER_Models.svg
@@ -0,0 +1 @@
+
\ No newline at end of file
diff --git a/docs/assets/images/Normalize_Augment_Company_Information_with_Wikidata.svg b/docs/assets/images/Normalize_Augment_Company_Information_with_Wikidata.svg
new file mode 100644
index 00000000000000..d7584dfdd85ded
--- /dev/null
+++ b/docs/assets/images/Normalize_Augment_Company_Information_with_Wikidata.svg
@@ -0,0 +1 @@
+
\ No newline at end of file
diff --git a/docs/demos/diagnoses_procedures.md b/docs/demos/diagnoses_procedures.md
index 4eadcc4a414037..8907ce8d0fee6a 100644
--- a/docs/demos/diagnoses_procedures.md
+++ b/docs/demos/diagnoses_procedures.md
@@ -104,4 +104,16 @@ data:
- text: Colab
type: blue_btn
url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/streamlit_notebooks/healthcare/RE_CLINICAL_DATE.ipynb
+ - title: Detect Available Pretrained NER Models
+ id: detect_available_pretrained_ner_models
+ image:
+ src: /assets/images/Detect_Available_Pretrained_NER_Models.svg
+ excerpt: This pipeline can be used to explore all the available pretrained NER models at once. When you run this pipeline over your text, you will end up with the predictions coming out of each pretrained clinical NER model.
+ actions:
+ - text: Live Demo
+ type: normal
+ url: https://demo.johnsnowlabs.com/healthcare/NER_PROFILING/
+ - text: Colab
+ type: blue_btn
+ url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/Certification_Trainings_JSL/Healthcare/1.Clinical_Named_Entity_Recognition_Model.ipynb
---
\ No newline at end of file
diff --git a/docs/demos/financial_company_normalization.md b/docs/demos/financial_company_normalization.md
index f80bf7fe6e6e57..88b839a0fa57e0 100644
--- a/docs/demos/financial_company_normalization.md
+++ b/docs/demos/financial_company_normalization.md
@@ -43,5 +43,17 @@ data:
url: https://demo.johnsnowlabs.com/finance/NEO4J/
- text: Colab
type: blue_btn
- url:
+ url:
+ - title: Normalize & Augment Company Information with Wikidata
+ id: normalize_augment_company_information_wikidata
+ image:
+ src: /assets/images/Normalize_Augment_Company_Information_with_Wikidata.svg
+ excerpt: This demo shows how to apply NER or Assertion Status to texts from Wikipedia. In addition, shows how you can create data dumps from Wikidata to include them in Spark NLP and use them online for data augmentation purposes, using Chunk Mappers and Entity Resolution.
+ actions:
+ - text: Live Demo
+ type: normal
+ url: https://demo.johnsnowlabs.com/finance/FINANCE_NLP_WITH_WIKIDATA/
+ - text: Colab
+ type: blue_btn
+ url:
---
\ No newline at end of file
diff --git a/docs/demos/social_determinant.md b/docs/demos/social_determinant.md
index ca59b0958e2936..35a9d3c8d9ead7 100644
--- a/docs/demos/social_determinant.md
+++ b/docs/demos/social_determinant.md
@@ -31,7 +31,7 @@ data:
url: https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_NER/
- text: Colab
type: blue_btn
- url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/streamlit_notebooks/healthcare/SOCIAL_DETERMINANT.ipynb
+ url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/streamlit_notebooks/healthcare/SOCIAL_DETERMINANT_NER.ipynb
- title: Classify Social Support
id: classify_social_support
image:
@@ -43,17 +43,29 @@ data:
url: https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_CLASSIFICATION/
- text: Colab
type: blue_btn
- url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/streamlit_notebooks/healthcare/SOCIAL_DETERMINANT.ipynb
- - title: Classify Substance Use, Alcohol and Tobacco Consumption, and Economic Status
- id: classify_substance_use_alcohol_tobacco_consumption_economic_status
+ url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/streamlit_notebooks/healthcare/SOCIAL_DETERMINANT.ipynb
+ - title: Classify Alcohol Status
+ id: classify_alcohol_status
image:
- src: /assets/images/Extract_Social_Determinants_of_Health.svg
- excerpt: This demo shows how you can detect social determinants of health in medical text using Spark NLP Healthcare Generic Classification models.
+ src: /assets/images/Classify_Alcohol_Status.svg
+ excerpt: This demo shows how you can detect alcohol use in medical text using Spark NLP Healthcare Generic Classification model.
actions:
- text: Live Demo
type: normal
- url: https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_GENERIC_CLASSIFICATION/
+ url: https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_ALCOHOL/
- text: Colab
type: blue_btn
- url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/streamlit_notebooks/healthcare/SOCIAL_DETERMINANT.ipynb
+ url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/streamlit_notebooks/healthcare/SOCIAL_DETERMINANT_CLASSIFICATION.ipynb
+ - title: Classify Tobacco Consumption
+ id: classify_tobacco_consumption
+ image:
+ src: /assets/images/Classify_Tobacco_Consumption.svg
+ excerpt: This demo shows how you can detect tobacco use in medical text using Spark NLP Healthcare Generic Classification model.
+ actions:
+ - text: Live Demo
+ type: normal
+ url: https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_TOBACCO/
+ - text: Colab
+ type: blue_btn
+ url: https://colab.research.google.com/github/JohnSnowLabs/spark-nlp-workshop/blob/master/tutorials/streamlit_notebooks/healthcare/SOCIAL_DETERMINANT_CLASSIFICATION.ipynb
---
diff --git a/docs/en/spark_nlp_healthcare_versions/licensed_release_notes.md b/docs/en/spark_nlp_healthcare_versions/licensed_release_notes.md
index c6dcd7d16481d6..5bbd6d5b787051 100644
--- a/docs/en/spark_nlp_healthcare_versions/licensed_release_notes.md
+++ b/docs/en/spark_nlp_healthcare_versions/licensed_release_notes.md
@@ -29,6 +29,8 @@ sidebar:
+ New and updated demos
+ 8 new clinical models and pipelines added & updated in total
+
+
#### The First Voice of Patients (VOP) Named Entity Recognition Model
We are releasing a new VOP NER model that was trained on the conversations gathered from patients forums.
@@ -80,6 +82,7 @@ sample_texts = ["Hello,I'm 20 year old girl. I'm diagnosed with hyperthyroid 1 m
+--------------------+-----+----+----------------------+
```
+
#### New Social Determinants of Health (SDOH) Named Entity Recognition Models
@@ -212,6 +215,8 @@ sample_texts = ["She has not been getting regular exercise and not followed diet
```
+
+
#### New Entity Resolver Model for Mapping Rxnorm Codes According To the National Institute of Health (NIH) Database
We are releasing `sbiobertresolve_rxnorm_nih` pretrained model to map clinical entities and concepts (like drugs/ingredients) to RxNorm codes according to the National Institute of Health (NIH) database using `sbiobert_base_cased_mli` Sentence Bert Embeddings.
@@ -239,8 +244,9 @@ text= "She is given folic acid 1 mg daily , levothyroxine 0.1 mg and aspirin 81
| aspirin 81 mg | DRUG | 12278696 | ['12278696', '12299811', '12298729', ...| ['aspirin 81 MG [aspirin 81 MG]', 'aspirin 81 MG [YSP Aspirin] [aspirin 81 MG ...|
```
+
- #### New Chunk Mapper Models For Mapping NDC Codes to Drug Brand Names As Well As Clinical Entities (like drugs/ingredients) to Rxnorm Codes
+#### New Chunk Mapper Models For Mapping NDC Codes to Drug Brand Names As Well As Clinical Entities (like drugs/ingredients) to Rxnorm Codes
We have two new chunk mapper models.
@@ -292,6 +298,8 @@ chunkerMapper = ChunkMapperModel\
+-------------------------+-------------+-----------+
```
+
+
#### Format Consistency For Formatted Entity Obfuscation In `Deidentification` Module
We have added a new `setSameLengthFormattedEntities` parameter that obfuscates the formatted entities like `PHONE`, `FAX`, `ID`, `IDNUM`, `BIOID`, `MEDICALRECORD`, `ZIP`, `VIN`, `SSN`, `DLN`, `PLATE` and `LICENSE` with the fake ones in the same format. Default is an empty list (`[]`).
@@ -329,7 +337,7 @@ Phone: (302) 786-5227"""
+--------------------------------+--------------------------------+------------------------------+
```
-
+
#### New Parameters For Controlling The Validation Set While Training a NER Model With `MedicalNerApproach`
@@ -349,6 +357,8 @@ nerTagger = MedicalNerApproach()\
...
```
+
+
#### Whitelisting The Entities While Merging Multiple Entities In `ChunkMergeApproach`
We have added `setWhiteList` parameter to `ChunkMergeApproach` annotator that you can whitelist detected entities while merging.
@@ -385,25 +395,27 @@ sample_text = "Mr. ABC is a 25 years old with a nonproductive cough that started
| 1 | May 2006 | DATE |
```
+
#### Core Improvements and Bug Fixes
- Fixed the bug in `get_assertion_data` method issue in ALAB module
- Updated documentation pages with corrections and additions.
+
#### New and Updated Notebooks
- Updated [Spark NLP for Healthcare Workshop in 3 hr](https://github.com/JohnSnowLabs/spark-nlp-workshop/blob/master/healthcare-nlp/00.SparkNLP_for_Healthcare_3h_Notebook.ipynb) with latest examples.
-
+
#### New and Updated Demos
+ [SOCIAL_DETERMINANT_ALCOHOL](https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_ALCOHOL/ ) demo
+ [SOCIAL_DETERMINANT_TOBACCO](https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_TOBACCO/ ) demo
-
+
#### 8 New Clinical Models and Pipelines Added & Updated in Total
@@ -417,13 +429,10 @@ sample_text = "Mr. ABC is a 25 years old with a nonproductive cough that started
+ `ndc_drug_brandname_mapper`
+ `rxnorm_nih_mapper`
-
-
+
For all Spark NLP for Healthcare models, please check: [Models Hub Page](https://nlp.johnsnowlabs.com/models?edition=Healthcare+NLP)
-
-
diff --git a/docs/en/spark_nlp_healthcare_versions/release_notes_4_3_1.md b/docs/en/spark_nlp_healthcare_versions/release_notes_4_3_1.md
index 938a46a92485cb..ee43fea60170fa 100644
--- a/docs/en/spark_nlp_healthcare_versions/release_notes_4_3_1.md
+++ b/docs/en/spark_nlp_healthcare_versions/release_notes_4_3_1.md
@@ -29,6 +29,8 @@ sidebar:
+ New and updated demos
+ 8 new clinical models and pipelines added & updated in total
+
+
#### The First Voice of Patients (VOP) Named Entity Recognition Model
We are releasing a new VOP NER model that was trained on the conversations gathered from patients forums.
@@ -80,6 +82,7 @@ sample_texts = ["Hello,I'm 20 year old girl. I'm diagnosed with hyperthyroid 1 m
+--------------------+-----+----+----------------------+
```
+
#### New Social Determinants of Health (SDOH) Named Entity Recognition Models
@@ -212,6 +215,8 @@ sample_texts = ["She has not been getting regular exercise and not followed diet
```
+
+
#### New Entity Resolver Model for Mapping Rxnorm Codes According To the National Institute of Health (NIH) Database
We are releasing `sbiobertresolve_rxnorm_nih` pretrained model to map clinical entities and concepts (like drugs/ingredients) to RxNorm codes according to the National Institute of Health (NIH) database using `sbiobert_base_cased_mli` Sentence Bert Embeddings.
@@ -239,8 +244,9 @@ text= "She is given folic acid 1 mg daily , levothyroxine 0.1 mg and aspirin 81
| aspirin 81 mg | DRUG | 12278696 | ['12278696', '12299811', '12298729', ...| ['aspirin 81 MG [aspirin 81 MG]', 'aspirin 81 MG [YSP Aspirin] [aspirin 81 MG ...|
```
+
- #### New Chunk Mapper Models For Mapping NDC Codes to Drug Brand Names As Well As Clinical Entities (like drugs/ingredients) to Rxnorm Codes
+#### New Chunk Mapper Models For Mapping NDC Codes to Drug Brand Names As Well As Clinical Entities (like drugs/ingredients) to Rxnorm Codes
We have two new chunk mapper models.
@@ -292,6 +298,8 @@ chunkerMapper = ChunkMapperModel\
+-------------------------+-------------+-----------+
```
+
+
#### Format Consistency For Formatted Entity Obfuscation In `Deidentification` Module
We have added a new `setSameLengthFormattedEntities` parameter that obfuscates the formatted entities like `PHONE`, `FAX`, `ID`, `IDNUM`, `BIOID`, `MEDICALRECORD`, `ZIP`, `VIN`, `SSN`, `DLN`, `PLATE` and `LICENSE` with the fake ones in the same format. Default is an empty list (`[]`).
@@ -329,7 +337,7 @@ Phone: (302) 786-5227"""
+--------------------------------+--------------------------------+------------------------------+
```
-
+
#### New Parameters For Controlling The Validation Set While Training a NER Model With `MedicalNerApproach`
@@ -349,6 +357,8 @@ nerTagger = MedicalNerApproach()\
...
```
+
+
#### Whitelisting The Entities While Merging Multiple Entities In `ChunkMergeApproach`
We have added `setWhiteList` parameter to `ChunkMergeApproach` annotator that you can whitelist detected entities while merging.
@@ -385,25 +395,27 @@ sample_text = "Mr. ABC is a 25 years old with a nonproductive cough that started
| 1 | May 2006 | DATE |
```
+
#### Core Improvements and Bug Fixes
- Fixed the bug in `get_assertion_data` method issue in ALAB module
- Updated documentation pages with corrections and additions.
+
#### New and Updated Notebooks
- Updated [Spark NLP for Healthcare Workshop in 3 hr](https://github.com/JohnSnowLabs/spark-nlp-workshop/blob/master/healthcare-nlp/00.SparkNLP_for_Healthcare_3h_Notebook.ipynb) with latest examples.
-
+
#### New and Updated Demos
+ [SOCIAL_DETERMINANT_ALCOHOL](https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_ALCOHOL/ ) demo
+ [SOCIAL_DETERMINANT_TOBACCO](https://demo.johnsnowlabs.com/healthcare/SOCIAL_DETERMINANT_TOBACCO/ ) demo
-
+
#### 8 New Clinical Models and Pipelines Added & Updated in Total
@@ -417,8 +429,7 @@ sample_text = "Mr. ABC is a 25 years old with a nonproductive cough that started
+ `ndc_drug_brandname_mapper`
+ `rxnorm_nih_mapper`
-
-
+
For all Spark NLP for Healthcare models, please check: [Models Hub Page](https://nlp.johnsnowlabs.com/models?edition=Healthcare+NLP)
@@ -428,4 +439,4 @@ For all Spark NLP for Healthcare models, please check: [Models Hub Page](https:/
## Versions
-{%- include docs-healthcare-pagination.html -%}
+{%- include docs-healthcare-pagination.html -%}
\ No newline at end of file