[Vertex AI] Test SDK with v1 API instead of v1beta
#862
vertexai.yml
on: pull_request
spm-package-resolved
1m 24s
Matrix: pod-lib-lint
Matrix: sample
Matrix: spm-unit
Matrix: testapp-integration
Annotations
4 errors, 4 warnings, and 79 notices
|
testapp-integration (iOS, macos-15):
FirebaseVertexAI/Tests/TestApp/Tests/Integration/IntegrationTests.swift#L245
testCountTokens_image_fileData_requiresUserAuth_wrongUser_permissionDenied, failed - Expected to throw an error, got response: CountTokensResponse(totalTokens: 266, totalBillableCharacters: Optional(35))
|
|
testapp-integration (iOS, macos-15):
FirebaseVertexAI/Tests/TestApp/Tests/Integration/IntegrationTests.swift#L95
testGenerateContent_image_fileData_requiresUserAuth_wrongUser_permissionDenied, failed - Expected to throw an error, got response: GenerateContentResponse(candidates: [FirebaseVertexAI.Candidate(content: FirebaseVertexAI.ModelContent(role: Optional("model"), internalParts: [FirebaseVertexAI.ModelContent.InternalPart.text("The color is pink. \n")]), safetyRatings: [FirebaseVertexAI.SafetyRating(category: FirebaseVertexAI.HarmCategory(rawValue: "HARM_CATEGORY_HATE_SPEECH"), probability: FirebaseVertexAI.SafetyRating.HarmProbability(rawValue: "NEGLIGIBLE"), probabilityScore: 0.05493164, severity: FirebaseVertexAI.SafetyRating.HarmSeverity(rawValue: "HARM_SEVERITY_NEGLIGIBLE"), severityScore: 0.1953125, blocked: false), FirebaseVertexAI.SafetyRating(category: FirebaseVertexAI.HarmCategory(rawValue: "HARM_CATEGORY_DANGEROUS_CONTENT"), probability: FirebaseVertexAI.SafetyRating.HarmProbability(rawValue: "NEGLIGIBLE"), probabilityScore: 0.056640625, severity: FirebaseVertexAI.SafetyRating.HarmSeverity(rawValue: "HARM_SEVERITY_NEGLIGIBLE"), severityScore: 0.08154297, blocked: false), FirebaseVertexAI.SafetyRating(category: FirebaseVertexAI.HarmCategory(rawValue: "HARM_CATEGORY_HARASSMENT"), probability: FirebaseVertexAI.SafetyRating.HarmProbability(rawValue: "NEGLIGIBLE"), probabilityScore: 0.057373047, severity: FirebaseVertexAI.SafetyRating.HarmSeverity(rawValue: "HARM_SEVERITY_NEGLIGIBLE"), severityScore: 0.075683594, blocked: false), FirebaseVertexAI.SafetyRating(category: FirebaseVertexAI.HarmCategory(rawValue: "HARM_CATEGORY_SEXUALLY_EXPLICIT"), probability: FirebaseVertexAI.SafetyRating.HarmProbability(rawValue: "NEGLIGIBLE"), probabilityScore: 0.048828125, severity: FirebaseVertexAI.SafetyRating.HarmSeverity(rawValue: "HARM_SEVERITY_NEGLIGIBLE"), severityScore: 0.095214844, blocked: false)], finishReason: Optional(FirebaseVertexAI.FinishReason(rawValue: "STOP")), citationMetadata: nil)], promptFeedback: nil, usageMetadata: Optional(FirebaseVertexAI.GenerateContentResponse.UsageMetadata(promptTokenCount: 271, candidatesTokenCount: 7, totalTokenCount: 278)))
|
|
testapp-integration (iOS, macos-15):
FirebaseVertexAI/Tests/TestApp/Tests/Integration/IntegrationTests.swift#L160
testGenerateContentStream_image_fileData_requiresUserAuth_wrongUser_permissionDenied, failed - Expected to throw an error, got response(s): [FirebaseVertexAI.GenerateContentResponse(candidates: [FirebaseVertexAI.Candidate(content: FirebaseVertexAI.ModelContent(role: Optional("model"), internalParts: [FirebaseVertexAI.ModelContent.InternalPart.text("The")]), safetyRatings: [], finishReason: nil, citationMetadata: nil)], promptFeedback: nil, usageMetadata: Optional(FirebaseVertexAI.GenerateContentResponse.UsageMetadata(promptTokenCount: 271, candidatesTokenCount: 1, totalTokenCount: 272))), FirebaseVertexAI.GenerateContentResponse(candidates: [FirebaseVertexAI.Candidate(content: FirebaseVertexAI.ModelContent(role: Optional("model"), internalParts: [FirebaseVertexAI.ModelContent.InternalPart.text(" color is pink. \n")]), safetyRatings: [FirebaseVertexAI.SafetyRating(category: FirebaseVertexAI.HarmCategory(rawValue: "HARM_CATEGORY_HATE_SPEECH"), probability: FirebaseVertexAI.SafetyRating.HarmProbability(rawValue: "NEGLIGIBLE"), probabilityScore: 0.05493164, severity: FirebaseVertexAI.SafetyRating.HarmSeverity(rawValue: "HARM_SEVERITY_NEGLIGIBLE"), severityScore: 0.1953125, blocked: false), FirebaseVertexAI.SafetyRating(category: FirebaseVertexAI.HarmCategory(rawValue: "HARM_CATEGORY_DANGEROUS_CONTENT"), probability: FirebaseVertexAI.SafetyRating.HarmProbability(rawValue: "NEGLIGIBLE"), probabilityScore: 0.056640625, severity: FirebaseVertexAI.SafetyRating.HarmSeverity(rawValue: "HARM_SEVERITY_NEGLIGIBLE"), severityScore: 0.08154297, blocked: false), FirebaseVertexAI.SafetyRating(category: FirebaseVertexAI.HarmCategory(rawValue: "HARM_CATEGORY_HARASSMENT"), probability: FirebaseVertexAI.SafetyRating.HarmProbability(rawValue: "NEGLIGIBLE"), probabilityScore: 0.057373047, severity: FirebaseVertexAI.SafetyRating.HarmSeverity(rawValue: "HARM_SEVERITY_NEGLIGIBLE"), severityScore: 0.075683594, blocked: false), FirebaseVertexAI.SafetyRating(category: FirebaseVertexAI.HarmCategory(rawValue: "HARM_CATEGORY_SEXUALLY_EXPLICIT"), probability: FirebaseVertexAI.SafetyRating.HarmProbability(rawValue: "NEGLIGIBLE"), probabilityScore: 0.048828125, severity: FirebaseVertexAI.SafetyRating.HarmSeverity(rawValue: "HARM_SEVERITY_NEGLIGIBLE"), severityScore: 0.095214844, blocked: false)], finishReason: Optional(FirebaseVertexAI.FinishReason(rawValue: "STOP")), citationMetadata: nil)], promptFeedback: nil, usageMetadata: Optional(FirebaseVertexAI.GenerateContentResponse.UsageMetadata(promptTokenCount: 271, candidatesTokenCount: 7, totalTokenCount: 278)))]
|
|
testapp-integration (iOS, macos-15)
Process completed with exit code 1.
|
|
spm-package-resolved
Cache save failed.
|
|
spm-unit (macos-15, Xcode_16, watchOS):
FirebaseVertexAI/Tests/Unit/ChatTests.swift#L46
code after 'throw' will never be executed
|
|
spm-unit (macos-15, Xcode_16, watchOS):
FirebaseVertexAI/Tests/Unit/GenerativeModelTests.swift#L1438
code after 'throw' will never be executed
|
|
spm-unit (macos-15, Xcode_16, watchOS):
FirebaseVertexAI/Tests/Unit/GenerativeModelTests.swift#L1464
code after 'throw' will never be executed
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatNonStreaming
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatStreaming
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.FunctionCallingSnippets.testFunctionCalling
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoNonStreaming
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoStreaming
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.StructuredOutputSnippets.testStructuredOutputEnumBasic
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.StructuredOutputSnippets.testStructuredOutputJSONBasic
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.TextSnippets.testTextOnlyNonStreaming
|
|
spm-unit (macos-15, Xcode_16, macOS)
Skipped FirebaseVertexAIUnit.TextSnippets.testTextOnlyStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatNonStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.FunctionCallingSnippets.testFunctionCalling
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesNonStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageNonStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoNonStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoStreaming
|
|
spm-unit (macos-15, Xcode_16, catalyst)
Skipped FirebaseVertexAIUnit.StructuredOutputSnippets.testStructuredOutputEnumBasic
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatNonStreaming
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatStreaming
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.FunctionCallingSnippets.testFunctionCalling
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesNonStreaming
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesStreaming
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageNonStreaming
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageStreaming
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoNonStreaming
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoStreaming
|
|
spm-unit (macos-15, Xcode_16, iOS)
Skipped FirebaseVertexAIUnit.StructuredOutputSnippets.testStructuredOutputEnumBasic
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatNonStreaming
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatStreaming
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.FunctionCallingSnippets.testFunctionCalling
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesNonStreaming
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesStreaming
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageNonStreaming
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageStreaming
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoNonStreaming
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoStreaming
|
|
spm-unit (macos-15, Xcode_16, visionOS)
Skipped FirebaseVertexAIUnit.StructuredOutputSnippets.testStructuredOutputEnumBasic
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatNonStreaming
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatStreaming
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.FunctionCallingSnippets.testFunctionCalling
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesNonStreaming
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesStreaming
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageNonStreaming
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageStreaming
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoNonStreaming
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoStreaming
|
|
spm-unit (macos-15, Xcode_16, tvOS)
Skipped FirebaseVertexAIUnit.StructuredOutputSnippets.testStructuredOutputEnumBasic
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatNonStreaming
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatStreaming
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.ChatTests.testMergingText
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.FunctionCallingSnippets.testFunctionCalling
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.GenerativeModelTests.testCountTokens_modelNotFound
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.GenerativeModelTests.testCountTokens_requestOptions_customTimeout
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.GenerativeModelTests.testCountTokens_succeeds_allOptions
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.GenerativeModelTests.testCountTokens_succeeds_noBillableCharacters
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.GenerativeModelTests.testCountTokens_succeeds
|
|
spm-unit (macos-15, Xcode_16, watchOS)
Skipped FirebaseVertexAIUnit.GenerativeModelTests.testGenerateContent_appCheck_tokenRefreshError
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatNonStreaming
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatStreaming
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.FunctionCallingSnippets.testFunctionCalling
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesNonStreaming
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesStreaming
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageNonStreaming
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageStreaming
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoNonStreaming
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoStreaming
|
|
spm-unit (macos-13, Xcode_15.2, iOS)
Skipped FirebaseVertexAIUnit.StructuredOutputSnippets.testStructuredOutputEnumBasic
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatNonStreaming
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.ChatSnippets.testChatStreaming
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.FunctionCallingSnippets.testFunctionCalling
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesNonStreaming
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalMultiImagesStreaming
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageNonStreaming
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalOneImageStreaming
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoNonStreaming
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.MultimodalSnippets.testMultimodalVideoStreaming
|
|
spm-unit (macos-14, Xcode_15.4, iOS)
Skipped FirebaseVertexAIUnit.StructuredOutputSnippets.testStructuredOutputEnumBasic
|