Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

540 Release Candidate #14247

Merged
merged 37 commits into from
Jul 1, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
deb0a45
closed the connection (#14233)
mehmetbutgul May 14, 2024
b3d491b
Fix missing java distribution for setup-java step
DevinTDHa May 14, 2024
d8a42c0
Lock macos version for runner
DevinTDHa May 14, 2024
5967577
Add missing sbt setup
DevinTDHa May 14, 2024
fcd4e9c
Add openvino dependency (#14255)
DevinTDHa May 21, 2024
4419a70
[SPARKNLP-1037] Adding addFile changes to to replace broadcast in all…
danilojsl May 21, 2024
fabc4ab
Integrating OpenVINO Runtime in Spark NLP (#14200)
rajatkrishna May 21, 2024
9430402
Fixing colab notebook bugs (#14249)
ahmedlone127 May 24, 2024
3f59375
adding model hub cards + updating readme + small typo fix on M2M100Te…
ahmedlone127 May 24, 2024
d083420
adding padded tokens (#14276)
ahmedlone127 May 24, 2024
e0e28e8
Sparknlp 1035 test all notebooks to import tensor flow models to spar…
ahmedlone127 May 24, 2024
262b802
Adding caching to streamlit demos (#14232)
AbdullahMubeenAnwar May 24, 2024
74f5151
Disable OpenVINO FastTest
DevinTDHa May 24, 2024
c2048be
Add openvino GPU dependency (#14309)
DevinTDHa Jun 3, 2024
adc193e
Fix incorrect LLAMA2 position ID (#14308)
rajatkrishna Jun 3, 2024
7274281
bump version to 5.4.0-rc1 [skip test]
maziyarpanahi Jun 5, 2024
9c075f8
Sparknlp 1016 implement mp net for token classification (#14322)
ahmedlone127 Jun 10, 2024
0ea5898
Uploading OpenVINO example notebooks (#14313)
rajatkrishna Jun 10, 2024
4583ccf
SparkNLP - 995 Introducing MistralAI LLMs (#14318)
prabod Jun 10, 2024
cdb031a
SparkNLP 1043 integrate new casual lm annotators to use open vino (#1…
prabod Jun 10, 2024
3054d4c
Fixed LLAMA generation bug (#14320)
prabod Jun 10, 2024
b4000d3
Fix compilation error
maziyarpanahi Jun 10, 2024
85c90dd
Bump to 5.4.0-rc2
maziyarpanahi Jun 10, 2024
1cba7e3
Add Pooling Average to Broken XXXForSentenceEmbedding annotators (#1…
ahmedlone127 Jun 12, 2024
903e780
Fix compilation error and formatting
maziyarpanahi Jun 12, 2024
54027a4
revert changes to BERT backend
maziyarpanahi Jun 12, 2024
4356794
Fix models link on FAQ (#14333)
dcecchini Jun 21, 2024
5a86b70
adding onnx support and average pooling (#14330)
ahmedlone127 Jun 21, 2024
ac9de09
uploading UAEEmbeddings notebook (#14324)
AbdullahMubeenAnwar Jun 21, 2024
e88682c
Bump version to 5.4.0 [skip test]
maziyarpanahi Jun 26, 2024
09dc500
Refactor OpenAIEmbeddings (#14334)
mehmetbutgul Jun 28, 2024
9d235e0
Update CHANGELOG [run doc]
maziyarpanahi Jun 28, 2024
036fc50
Update Scala and Python APIs
actions-user Jun 28, 2024
86e6725
Update ORT and Azure deps
maziyarpanahi Jun 28, 2024
a5b88ad
add the missing OpenVINO coordinates
maziyarpanahi Jun 29, 2024
1502757
set ORT to 1.18.0
maziyarpanahi Jun 29, 2024
595b8f4
Update jsl-openvino to GA
maziyarpanahi Jun 29, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
10 changes: 5 additions & 5 deletions .github/workflows/build_and_test.yml
Original file line number Diff line number Diff line change
Expand Up @@ -33,17 +33,17 @@ on:
jobs:
spark34:
if: "! contains(toJSON(github.event.commits.*.message), '[skip test]')"
runs-on: macos-latest
runs-on: macos-13
env:
TF_CPP_MIN_LOG_LEVEL: 3
JAVA_OPTS: "-Xmx4096m -XX:+UseG1GC"
name: Build and Test on Apache Spark 3.4.x

steps:
- uses: actions/checkout@v3
- uses: actions/setup-java@v3
- uses: actions/setup-java@v4
with:
distribution: 'adopt'
distribution: 'temurin'
java-version: '8'
cache: 'sbt'
- name: Install Python 3.7
Expand Down Expand Up @@ -73,7 +73,7 @@ jobs:
python3.7 -m pytest -v -m fast
spark35:
if: "! contains(toJSON(github.event.commits.*.message), '[skip test]')"
runs-on: macos-latest
runs-on: macos-13
env:
TF_CPP_MIN_LOG_LEVEL: 3
JAVA_OPTS: "-Xmx4096m -XX:+UseG1GC"
Expand Down Expand Up @@ -109,7 +109,7 @@ jobs:

spark33:
if: "! contains(toJSON(github.event.commits.*.message), '[skip test]')"
runs-on: macos-latest
runs-on: macos-13
env:
TF_CPP_MIN_LOG_LEVEL: 3
JAVA_OPTS: "-Xmx4096m -XX:+UseG1GC"
Expand Down
24 changes: 24 additions & 0 deletions CHANGELOG
Original file line number Diff line number Diff line change
@@ -1,3 +1,27 @@
========
5.4.0
========
----------------
New Features & Enhancements
----------------
* Added OpenVINO Runtime integration for various models, enabling enhanced inference performance. (#14246)
* Added Python APIs to incorporate OpenVINO support. (#14242)
* Introduced support for ONNX models and average pooling in ONNX-based annotators. (#14245)
* Implemented MPNet for token classification. (#14244)
* Added support for MistralAI LLM and LLAMA2. (#14243)
* Improved caching mechanisms in Streamlit demos. (#14241)
* Enhanced models' card and README documentation for Models Hub. (#14240)
* Added OpenVINO GPU dependencies. (#14236)
* Locked macOS version for runners and added missing SBT setup. (#14235)

----------------
Bug Fixes
----------------
* Fixed bugs in Colab notebooks. (#14239)
* Resolved issues with BERT backend and broken annotators. (#14238)
* Corrected LLAMA2 position ID and generation bug. (#14237)


========
5.3.3
========
Expand Down
Loading
Loading