Boost tensor fields #300

pandu-k · 2023-02-01T21:47:27Z

What kind of change does this PR introduce? (Bug fix, feature, docs update, ...)
Feature
What is the current behavior? (You can also link to an open issue here)
No way to boost/anti-boost fields
What is the new behavior (if this is a feature change)?
Now a way to boost fields relative to eachother, during search
Does this PR introduce a breaking change? (What changes might users need to make in their application due to this PR?)
no
Have unit tests been run against this PR? (Has there also been any additional testing?)
In progress
Related Python client changes (link commit/PR here)
TODO
Related documentation changes (link commit/PR here)
Boost: https://gh-previews.marqo.pages.dev/0.0.13/API-Reference/search/#boost
Other information:
Please check if the PR fulfills these requirements

The commit message follows our guidelines
Tests for the changes have been added (for bug fixes/features)
Docs have been added / updated (for bug fixes / features)

pandu-k · 2023-02-01T21:56:05Z

tests/tensor_search/test_boost_field_scores.py

+from tests.marqo_test import MarqoTestCase
+
+
+class TestBoostFieldScores(MarqoTestCase):


Can we test with more documents (10 or so) with varying fields, with varying other params (like pagination)?

wanliAlex · 2023-02-10T07:52:29Z

pagination, use [1,1] as boost dic for both fields.

wanliAlex · 2023-02-10T07:57:55Z

Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 1
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 2
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 3
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 4
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 5
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 6
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 7
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 8
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 9
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 10
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 11
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 12
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 13
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 14
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 15
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 16
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 17
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 18
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
Description
before boost:0.7821903
after boost:1.7821903
Title
before boost:0.9306991
after boost:1.9306991
DELETNE to be bootsed
Number of doc 19

different number of docs

wanliAlex · 2023-02-10T08:04:20Z

Title
before boost:0.9306991
after boost:1.9306991
void_field_3
before boost:0.49232623
after boost:1.49232623
Description
before boost:0.7821903
after boost:1.7821903
void_field_8
before boost:0.48269674
after boost:1.48269674
void_field_6
before boost:0.4840921
after boost:1.4840921
void_field_1
before boost:0.48407263
after boost:1.48407263
void_field_5
before boost:0.48731607
after boost:1.4873160699999999
void_field_4
before boost:0.4855699
after boost:1.4855699
void_field_7
before boost:0.4828252
after boost:1.4828252

different number of fields, use boost [1,1]

wanliAlex · 2023-02-10T08:10:18Z

void_field_1
before boost:0.48407263
after boost:-1.48407263
void_field_5
before boost:0.48731607
after boost:-1.4873160699999999
void_field_7
before boost:0.4828252
after boost:-1.4828252
void_field_6
before boost:0.4840921
after boost:-1.4840921
void_field_8
before boost:0.48269674
after boost:-1.48269674
void_field_2
before boost:0.48322064
after boost:-1.4832206399999999
Title
before boost:0.9306991
after boost:0.0
Description
before boost:0.7821903
after boost:1.7821903
void_field_3
before boost:0.49232623
after boost:-1.49232623
void_field_4
before boost:0.4855699
after boost:-1.4855699
void_field_1
before boost:0.48407263
after boost:-1.48407263
void_field_5
before boost:0.48731607
after boost:-1.4873160699999999
void_field_7
before boost:0.4828252
after boost:-1.4828252
void_field_6
before boost:0.4840921
after boost:-1.4840921
void_field_8
before boost:0.48269674
after boost:-1.48269674
void_field_2
before boost:0.48322064
after boost:-1.4832206399999999
Title
before boost:0.9306991
after boost:0.0
Description
before boost:0.7821903
after boost:1.7821903

title [0,0], description[1,1], void_field[-1,-1]

wanliAlex · 2023-02-10T08:12:31Z

Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
DELETNE to be bootsed
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
DELETNE to be bootsed
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
DELETNE to be bootsed
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
DELETNE to be bootsed
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
DELETNE to be bootsed
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
DELETNE to be bootsed
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
Description
before boost:0.7821903
after boost:4.5643806
Title
before boost:0.9306991
after boost:-4.7920973
DELETNE to be boosted

title: [-3,-2], description [2,3]

aryanagarwal9 added 4 commits February 1, 2023 02:25

added field score boosters

a8f00b6

add tests

ec208b2

added error handling

4a5a5ac

added tests

7e0d00c

pandu-k commented Feb 1, 2023

View reviewed changes

Merge branch 'mainline' into re-weight-search

fbca383

pandu-k changed the title ~~Re weight search~~ Boost tensor fields Feb 9, 2023

pandu-k added 2 commits February 9, 2023 13:47

Added validation to boost

b14b046

added exclude vectors to search

232c869

pandu-k marked this pull request as ready for review February 9, 2023 07:28

pandu-k temporarily deployed to marqo-test-suite February 9, 2023 07:29 — with GitHub Actions Inactive

Merge branch 'mainline' into re-weight-search

71cc8a0

jn2clark approved these changes Feb 10, 2023

View reviewed changes

wanliAlex added 4 commits February 10, 2023 17:32

add a test to test boost equation.

c5fcd08

add a test to test boost equation.

c26c7ed

add a test to test boost equation.

500b718

add test to different scores

e04388e

wanliAlex and others added 3 commits February 10, 2023 19:13

add test to different scores

6c2645e

delete print

b1a23b5

added extra image search test

1276144

pandu-k merged commit 0a0cea4 into mainline Feb 10, 2023

pandu-k deleted the re-weight-search branch February 10, 2023 12:02

wanliAlex mentioned this pull request Feb 10, 2023

Search weight boost marqo-ai/py-marqo#56

Merged

3 tasks

jn2clark mentioned this pull request Mar 8, 2023

[ENHANCEMENT] Re-weighting the search results by field #201

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Boost tensor fields #300

Boost tensor fields #300

pandu-k commented Feb 1, 2023 •

edited

Loading

pandu-k Feb 1, 2023

wanliAlex commented Feb 10, 2023 •

edited

Loading

wanliAlex commented Feb 10, 2023

wanliAlex commented Feb 10, 2023

wanliAlex commented Feb 10, 2023

wanliAlex commented Feb 10, 2023

		from tests.marqo_test import MarqoTestCase


		class TestBoostFieldScores(MarqoTestCase):

Boost tensor fields #300

Boost tensor fields #300

Conversation

pandu-k commented Feb 1, 2023 • edited Loading

pandu-k Feb 1, 2023

Choose a reason for hiding this comment

wanliAlex commented Feb 10, 2023 • edited Loading

wanliAlex commented Feb 10, 2023

wanliAlex commented Feb 10, 2023

wanliAlex commented Feb 10, 2023

wanliAlex commented Feb 10, 2023

pandu-k commented Feb 1, 2023 •

edited

Loading

wanliAlex commented Feb 10, 2023 •

edited

Loading