Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support Vector Regions managements with vector #117

Closed
msmygit opened this issue Oct 5, 2023 · 2 comments
Closed

Support Vector Regions managements with vector #117

msmygit opened this issue Oct 5, 2023 · 2 comments
Assignees
Labels
enhancement New feature or request ready_for_release
Milestone

Comments

@msmygit
Copy link
Collaborator

msmygit commented Oct 5, 2023

Describe the bug

Azure westus3 region is not recognized in commands like astra db create-dotenv.

I've a database (vector flavor) in production (https://astra.datastax.com) in Azure westus3 region,
image

This can be seen even when invoking the list operation:

astra db list
+----------------------------------------------------+--------------------------------------+---------------+-------+---+-----------+
| Name                                               | id                                   | Regions       | Cloud | V | Status    |
+----------------------------------------------------+--------------------------------------+---------------+-------+---+-----------+
| vector                                             | 490e08b6-REDACTED-ef                 | westus3       | azure | ■ | ACTIVE    |
+----------------------------------------------------+--------------------------------------+---------------+-------+---+-----------+

To Reproduce

Steps to reproduce the behavior:

FWIW, I'm using an Organization Administrator based token.

Now, when you execute

% astra db create-dotenv vector -d .    
[ERROR] INVALID_ARGUMENT: Provided region is invalid pick one of [francecentral, australiaeast, ap-south-1, westeurope, me-central-1, eastus2, northamerica-northeast1, northamerica-northeast2, eu-central-1, asia-northeast1, us-west-2, australia-southeast1, europe-west2, centralindia, europe-west3, europe-west4, eu-west-2, eu-west-1, us-central1, us-west4, europe-west1, sa-east-1, us-west1, westus2, canadacentral, ap-east-1, us-east4, asia-south1, us-east1, ap-southeast-1, ap-southeast-2, us-east-1, us-east-2, eastus]

Expected behavior
It should have clearly created an env file for me.

Screenshots
See bug description above.

Desktop (please complete the following information):

  • OS: macOS
  • Version: Ventura 13.5.1

Additional context
Hunch is that the DevOps API isn't returning this region, but unsure how to confirm.

@clun
Copy link
Collaborator

clun commented Oct 24, 2023

As of today validation is done against the serverless list
(https://api.astra.datastax.com/v2/regions/serverless)

astra db list-regions-serverless -c azure
+-----------------+-------------------------+---------------------------------------+
| Cloud Provider  | Region                  | Full Name                             |
+-----------------+-------------------------+---------------------------------------+
| azure           | australiaeast           | Australia East                        |
| azure           | canadacentral           | Canada Central (Toronto)              |
| azure           | centralindia            | Central India (Pune)                  |
| azure           | eastus                  | US East                               |
| azure           | eastus2                 | US East 2 (Virginia)                  |
| azure           | francecentral           | France Central                        |
| azure           | westeurope              | West Europe                           |
| azure           | westus2                 | US West (Washington)                  |

it is showing up for astra classic
(https://api.astra.datastax.com/v2/availableRegions)

astra db list-regions-classic -c azure
+-----------------+---------------------+-------------------------------+
| Cloud Provider  | Region              | Full Name                     |
+-----------------+---------------------+-------------------------------+
| azure           | australiaeast       | Australia East                |
| azure           | brazilsouth         | Brazil South                  |
| azure           | canadacentral       | Canada Central (Toronto)      |
| azure           | centralindia        | Central India                 |
| azure           | centralus           | (US) Central US               |
| azure           | eastus2             | East US 2 (Virginia)          |
| azure           | northeurope         | North Europe                  |
| azure           | southcentralus      | South Central US              |
| azure           | westeurope          | West Europe                   |
| azure           | westus2             | West US 2 (Washington)        |
| azure           | westus3             | West US 3                     |
+-----------------+---------------------+-------------------------------+

Checking internally there is distinct to be done in serverless and serverless vector. A couple of evolutions are needed.

@clun clun self-assigned this Oct 24, 2023
@clun clun added in progress bug Something isn't working enhancement New feature or request and removed bug Something isn't working labels Oct 24, 2023
@clun clun changed the title [BUG] - Azure westus3 region is not recognized Support Vector Regions managements with vector Oct 26, 2023
@clun
Copy link
Collaborator

clun commented Oct 26, 2023

  • When you list DB you can limit to vector with --vector flag
./target/astra db list --vector
+-----------------------+--------------------------------------+-----------+-------+---+-----------+
| Name                  | id                                   | Regions   | Cloud | V | Status    |
+-----------------------+--------------------------------------+-----------+-------+---+-----------+
| ummo                  | 581f260a-b26b-46eb-921b-2aa04cf5a41b | us-east1  | gcp   | ■ | ACTIVE    |
| sdk_java_test_vector  | 2597b6f6-c2a9-4dc2-aef8-b9fe840848cc | us-east1  | gcp   | ■ | ACTIVE    |
| astra_cli_vector_test | 8d0b1ca1-b08d-4da9-8838-1e5694b6e446 | us-east1  | gcp   | ■ | ACTIVE    |
+-----------------------+--------------------------------------+-----------+-------+---+-----------+
  • Serverless return a list of regions for astra db serverless (CQL) not vector
./target/astra db list-regions-serverless
+-----------------+-------------------------+---------------------------------------+
| Cloud Provider  | Region                  | Full Name                             |
+-----------------+-------------------------+---------------------------------------+
| aws             | ap-east-1               | Asia Pacific (Hong Kong)              |
| aws             | ap-south-1              | Asia Pacific (Mumbai)                 |
| aws             | ap-southeast-1          | Asia Pacific (Singapore)              |
| aws             | ap-southeast-2          | Asia Pacific (Sydney)                 |
| aws             | eu-central-1            | Europe (Frankfurt)                    |
| aws             | eu-west-1               | Europe (Ireland)                      |
| aws             | eu-west-2               | Europe (London)                       |
| aws             | me-central-1            | Middle East (UAE)                     |
| aws             | sa-east-1               | South America (Sao Paulo)             |
| aws             | us-east-1               | US East (N. Virginia)                 |
| aws             | us-east-2               | US East (Ohio)                        |
| aws             | us-west-2               | US West (Oregon)                      |
| azure           | australiaeast           | Australia East                        |
| azure           | canadacentral           | Canada Central (Toronto)              |
| azure           | centralindia            | Central India (Pune)                  |
| azure           | eastus                  | US East                               |
| azure           | eastus2                 | US East 2 (Virginia)                  |
| azure           | francecentral           | France Central                        |
| azure           | westeurope              | West Europe                           |
| azure           | westus2                 | US West (Washington)                  |
| azure           | westus3                 | US West 3                             |
| gcp             | asia-northeast1         | Asia Northeast1 (Tokyo, Japan)        |
| gcp             | asia-south1             | Mumbai, India                         |
| gcp             | australia-southeast1    | Sydney, Australia, APAC               |
| gcp             | europe-west1            | St. Ghislain, Belgium                 |
| gcp             | europe-west2            | West Europe2 (London, England, UK)    |
| gcp             | europe-west3            | West Europe3 (Frankfurt, Germany)     |
| gcp             | europe-west4            | West Europe4 (Eemshaven, Netherlands) |
| gcp             | northamerica-northeast1 | Montreal, Quebec                      |
| gcp             | northamerica-northeast2 | Toronto, Ontario                      |
| gcp             | us-central1             | Council Bluffs, Iowa                  |
| gcp (free-tier) | us-east1                | Moncks Corner, South Carolina         |
| gcp             | us-east4                | Ashburn, Virginia                     |
| gcp             | us-west1                | The Dalles, Oregon                    |
| gcp             | us-west4                | US West (Las Vegas, USA)              |
+-----------------+-------------------------+---------------------------------------+
  • New command to return vector list
./target/astra db list-regions-vector
+-----------------+---------------------+-------------------------------+
| Cloud Provider  | Region              | Full Name                     |
+-----------------+---------------------+-------------------------------+
| aws             | ap-south-1          | Asia Pacific (Mumbai)         |
| aws             | us-east-2           | US East (Ohio)                |
| azure           | westus3             | US West 3                     |
| gcp (free-tier) | us-east1            | Moncks Corner, South Carolina |
+-----------------+---------------------+-------------------------------+
  • Update validation of create-dotenv to pick the correct list

  • Always perform region validation from the tier and vector flag (create db, ...)

./target/astra db create db_vector -r westus3 -c azure --vector

[INFO]  Database 'db_vector' does not exist. Creating database 'db_vector' with keyspace 'default_keyspace'
get CLoud provider
[INFO]  Enabling vector search for database db_vector

@clun clun added this to the 0.5 milestone Nov 2, 2023
@clun clun closed this as completed Nov 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request ready_for_release
Projects
None yet
Development

No branches or pull requests

2 participants