Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure: performance_test_basic_read_only_trxs #425

Closed
heifner opened this issue Jul 27, 2024 · 12 comments · Fixed by #684, #687, #1102 or AntelopeIO/eos-vm#30
Closed

Test failure: performance_test_basic_read_only_trxs #425

heifner opened this issue Jul 27, 2024 · 12 comments · Fixed by #684, #687, #1102 or AntelopeIO/eos-vm#30
Assignees
Labels
👍 lgtm test-instability tag issues for flaky tests, high priority to address
Milestone

Comments

@heifner
Copy link
Member

heifner commented Jul 27, 2024

https://github.com/AntelopeIO/spring/actions/runs/10119591629/job/27988450741

@enf-ci-bot enf-ci-bot moved this to Todo in Team Backlog Jul 27, 2024
@arhag arhag added test-instability tag issues for flaky tests, high priority to address 👍 lgtm and removed triage labels Jul 29, 2024
@arhag arhag added this to the Savanna: Beta 4.x milestone Jul 29, 2024
@heifner
Copy link
Member Author

heifner commented Aug 5, 2024

One of the read-only trx failed:

error 2024-07-27T01:22:38.698 provider_ trx_provider.cpp:194          operator()           ] async_http_request Transaction receipt status not executed: {"transaction_id":"6dcb06b1cb5daf2961b2b46726aa332c5a992a1b94b89959aea3616e6d435f1d","processed":{"id":"6dcb06b1cb5daf2961b2b46726aa332c5a992a1b94b89959aea3616e6d435f1d","block_num":129,"block_time":"2024-07-27T01:22:39.000","producer_block_id":null,"receipt":null,"elapsed":28690,"net_usage":136,"scheduled":false,"action_traces":[{"action_ordinal":1,"creator_action_ordinal":0,"closest_unnotified_ancestor_action_ordinal":0,"receipt":{"receiver":"eosio.null","act_digest":"ee1d076537c2e998aaa0947b9ca10db8f062bcaf86a14d46e515d077c2f722b4","global_sequence":0,"recv_sequence":0,"auth_sequence":[],"code_sequence":0,"abi_sequence":0},"receiver":"eosio.null","act":{"account":"eosio.null","name":"nonce","authorization":[],"data":"29313a32393a373339363131393930303630393035323638373a31373232303433333538353834353233","hex_data":"29313a32393a373339363131393930303630393035323638373a31373232303433333538353834353233"},"context_free":true,"elapsed":7,"console":"","trx_id":"6dcb06b1cb5daf2961b2b46726aa332c5a992a1b94b89959aea3616e6d435f1d","block_num":129,"block_time":"2024-07-27T01:22:39.000","producer_block_id":null,"account_ram_deltas":[],"except":null,"error_code":null,"return_value_hex_data":""},{"action_ordinal":2,"creator_action_ordinal":0,"closest_unnotified_ancestor_action_ordinal":0,"receipt":null,"receiver":"payloadless","act":{"account":"payloadless","name":"doitslow","authorization":[],"data":"","hex_data":""},"context_free":false,"elapsed":28632,"console":"Im a payloadless slow action","trx_id":"6dcb06b1cb5daf2961b2b46726aa332c5a992a1b94b89959aea3616e6d435f1d","block_num":129,"block_time":"2024-07-27T01:22:39.000","producer_block_id":null,"account_ram_deltas":[],"except":{"code":3070002,"name":"wasm_execution_error","message":"Runtime Error Processing WASM","stack":[{"context":{"level":"error","file":"eos-vm.cpp","line":165,"method":"apply","hostname":"","thread_name":"read-0","timestamp":"2024-07-27T01:22:38.694"},"format":"access violation","data":{}},{"context":{"level":"warn","file":"apply_context.cpp","line":134,"method":"exec_one","hostname":"","thread_name":"read-0","timestamp":"2024-07-27T01:22:38.694"},"format":"${receiver} <= ${account}::${action} pending console output: ${console}","data":{"console":"Im a payloadless slow action","account":"payloadless","action":"doitslow","receiver":"payloadless"}}]},"error_code":"10000000000000000000","return_value_hex_data":""}],"account_ram_delta":null,"except":{"code":3070002,"name":"wasm_execution_error","message":"Runtime Error Processing WASM","stack":[{"context":{"level":"error","file":"eos-vm.cpp","line":165,"method":"apply","hostname":"","thread_name":"read-0","timestamp":"2024-07-27T01:22:38.694"},"format":"access violation","data":{}},{"context":{"level":"warn","file":"apply_context.cpp","line":134,"method":"exec_one","hostname":"","thread_name":"read-0","timestamp":"2024-07-27T01:22:38.694"},"format":"${receiver} <= ${account}::${action} pending console output: ${console}","data":{"console":"Im a payloadless slow action","account":"payloadless","action":"doitslow","receiver":"payloadless"}}]},"error_code":"10000000000000000000"}}

Which includes the error:

,"except":{"code":3070002,"name":"wasm_execution_error","message":"Runtime Error Processing WASM","stack":[{"context":{"level":"error","file":"eos-vm.cpp","line":165,"method":"apply","hostname":"","thread_name":"read-0","timestamp":"2024-07-27T01:22:38.694"},"format":"access violation","data":{}}

Here is the contract:

void payloadless::doitslow() {

@heifner
Copy link
Member Author

heifner commented Aug 5, 2024

Highly doubt this has anything at all to do with Spring changes.

@arhag arhag removed this from the Savanna: Beta 4.x milestone Aug 6, 2024
@heifner
Copy link
Member Author

heifner commented Aug 28, 2024

Transactions logged as sent but NOT FOUND in block!! lost 1 out of 100
https://github.com/AntelopeIO/spring/actions/runs/10599331165/job/29374893195

Same issue as before:

"except":{"code":3070002,"name":"wasm_execution_error","message":"Runtime Error Processing WASM","stack":[{"context":{"level":"error","file":"eos-vm.cpp","line":165,"method":"apply","hostname":"","thread_name":"read-0","timestamp":"2024-08-28T15:19:44.787"},"format":"access violation","data":{}},{"context":{"level":"warn","file":"apply_context.cpp","line":134,"method":"exec_one","hostname":"","thread_name":"read-0","timestamp":"2024-08-28T15:19:44.787"},"format":"${receiver} <= ${account}::${action} pending console output: ${console}","data":{"console":"Im a payloadless slow action","account":"payloadless","action":"doitslow","receiver":"payloadless"}}]},"error_code":"10000000000000000000"}}

@greg7mdp
Copy link
Contributor

Here is the contract:

see is_mersenne_prime in contract. I believe that operator<<() with a rhs value greater than the number of bits in lhs is UB.

@heifner heifner reopened this Sep 4, 2024
@github-project-automation github-project-automation bot moved this from Done to Todo in Team Backlog Sep 4, 2024
@arhag arhag modified the milestones: Spring v1.0.0, Spring v1.0.1 Sep 4, 2024
@spoonincode
Copy link
Member

heifner added a commit that referenced this issue Nov 1, 2024
Capture trx_generator output in tests
@heifner
Copy link
Member Author

heifner commented Nov 6, 2024

https://github.com/AntelopeIO/spring/actions/runs/11692851657/job/32563620604
We are now capturing the output of the trx_generator failure:

error 2024-11-05T21:48:27.846 provider_ trx_provider.cpp:194 operator() ] async_http_request Transaction receipt status not executed: {"transaction_id":"dc2929badb9da92550217a8d97e8357f76474d1b5215706a845409f624120f7c","processed":{"id":"dc2929badb9da92550217a8d97e8357f76474d1b5215706a845409f624120f7c","block_num":119,"block_time":"2024-11-05T21:48:28.000","producer_block_id":null,"receipt":null,"elapsed":30792,"net_usage":136,"scheduled":false,"action_traces":[{"action_ordinal":1,"creator_action_ordinal":0,"closest_unnotified_ancestor_action_ordinal":0,"receipt":{"receiver":"eosio.null","act_digest":"f2d1a9e2be396f7adbcc72f7592213d14847a5eda4074738a39d6c96ab03dead","global_sequence":0,"recv_sequence":0,"auth_sequence":[],"code_sequence":0,"abi_sequence":0},"receiver":"eosio.null","act":{"account":"eosio.null","name":"nonce","authorization":[],"data":"29313a31393a373433333931353339333737303532303538363a31373330383433333037373730303533","hex_data":"29313a31393a373433333931353339333737303532303538363a31373330383433333037373730303533"},"context_free":true,"elapsed":9,"console":"","trx_id":"dc2929badb9da92550217a8d97e8357f76474d1b5215706a845409f624120f7c","block_num":119,"block_time":"2024-11-05T21:48:28.000","producer_block_id":null,"account_ram_deltas":[],"except":null,"error_code":null,"return_value_hex_data":""},{"action_ordinal":2,"creator_action_ordinal":0,"closest_unnotified_ancestor_action_ordinal":0,"receipt":null,"receiver":"payloadless","act":{"account":"payloadless","name":"doitslow","authorization":[],"data":"","hex_data":""},"context_free":false,"elapsed":30728,"console":"Im a payloadless slow action","trx_id":"dc2929badb9da92550217a8d97e8357f76474d1b5215706a845409f624120f7c","block_num":119,"block_time":"2024-11-05T21:48:28.000","producer_block_id":null,"account_ram_deltas":[],"except":{"code":3070002,"name":"wasm_execution_error","message":"Runtime Error Processing WASM","stack":[{"context":{"level":"error","file":"eos-vm.cpp","line":165,"method":"apply","hostname":"","thread_name":"read-0","timestamp":"2024-11-05T21:48:27.844"},"format":"access violation","data":{}},{"context":{"level":"warn","file":"apply_context.cpp","line":134,"method":"exec_one","hostname":"","thread_name":"read-0","timestamp":"2024-11-05T21:48:27.844"},"format":"${receiver} <= ${account}::${action} pending console output: ${console}","data":{"console":"Im a payloadless slow action","account":"payloadless","action":"doitslow","receiver":"payloadless"}}]},"error_code":"10000000000000000000","return_value_hex_data":""}],"account_ram_delta":null,"except":{"code":3070002,"name":"wasm_execution_error","message":"Runtime Error Processing WASM","stack":[{"context":{"level":"error","file":"eos-vm.cpp","line":165,"method":"apply","hostname":"","thread_name":"read-0","timestamp":"2024-11-05T21:48:27.844"},"format":"access violation","data":{}},{"context":{"level":"warn","file":"apply_context.cpp","line":134,"method":"exec_one","hostname":"","thread_name":"read-0","timestamp":"2024-11-05T21:48:27.844"},"format":"${receiver} <= ${account}::${action} pending console output: ${console}","data":{"console":"Im a payloadless slow action","account":"payloadless","action":"doitslow","receiver":"payloadless"}}]},"error_code":"10000000000000000000"}}

heifner added a commit that referenced this issue Nov 6, 2024
@heifner
Copy link
Member Author

heifner commented Dec 19, 2024

https://github.com/AntelopeIO/spring/actions/runs/12399959278/job/34616613579

error 2024-12-18T19:43:45.809 provider_ trx_provider.cpp:193          operator()           ] async_http_request Transaction receipt status not executed: {"transaction_id":"5f96f03b21541b533a71fdebf06d01a2a36704537d204b6a3e10034411db0f91","processed":{"id":"5f96f03b21541b533a71fdebf06d01a2a36704537d204b6a3e10034411db0f91","block_num":122,"block_time":"2024-12-18T19:43:46.000","producer_block_id":null,"receipt":null,"elapsed":25274,"net_usage":136,"scheduled":false,"action_traces":[{"action_ordinal":1,"creator_action_ordinal":0,"closest_unnotified_ancestor_action_ordinal":0,"receipt":{"receiver":"eosio.null","act_digest":"a0c7656a41cfdb55231c50ed83766ba8f7bd5e33a7f1b735273e04088d9bbb4e","global_sequence":0,"recv_sequence":0,"auth_sequence":[],"code_sequence":0,"abi_sequence":0},"receiver":"eosio.null","act":{"account":"eosio.null","name":"nonce","authorization":[],"data":"29313a31393a373434393833393932313332333331313131343a31373334353531303235373632353632","hex_data":"29313a31393a373434393833393932313332333331313131343a31373334353531303235373632353632"},"context_free":true,"elapsed":14,"console":"","trx_id":"5f96f03b21541b533a71fdebf06d01a2a36704537d204b6a3e10034411db0f91","block_num":122,"block_time":"2024-12-18T19:43:46.000","producer_block_id":null,"account_ram_deltas":[],"except":null,"error_code":null,"return_value_hex_data":""},{"action_ordinal":2,"creator_action_ordinal":0,"closest_unnotified_ancestor_action_ordinal":0,"receipt":null,"receiver":"payloadless","act":{"account":"payloadless","name":"doitslow","authorization":[],"data":"","hex_data":""},"context_free":false,"elapsed":25182,"console":"Im a payloadless slow action","trx_id":"5f96f03b21541b533a71fdebf06d01a2a36704537d204b6a3e10034411db0f91","block_num":122,"block_time":"2024-12-18T19:43:46.000","producer_block_id":null,"account_ram_deltas":[],"except":{"code":3070002,"name":"wasm_execution_error","message":"Runtime Error Processing WASM","stack":[{"context":{"level":"error","file":"eos-vm.cpp","line":165,"method":"apply","hostname":"","thread_name":"read-0","timestamp":"2024-12-18T19:43:45.808"},"format":"access violation: ${d}","data":{"d":"wasm memory out-of-bounds"}},{"context":{"level":"warn","file":"apply_context.cpp","line":134,"method":"exec_one","hostname":"","thread_name":"read-0","timestamp":"2024-12-18T19:43:45.809"},"format":"${receiver} <= ${account}::${action} pending console output: ${console}","data":{"console":"Im a payloadless slow action","account":"payloadless","action":"doitslow","receiver":"payloadless"}}]},"error_code":"10000000000000000000","return_value_hex_data":""}],"account_ram_delta":null,"except":{"code":3070002,"name":"wasm_execution_error","message":"Runtime Error Processing WASM","stack":[{"context":{"level":"error","file":"eos-vm.cpp","line":165,"method":"apply","hostname":"","thread_name":"read-0","timestamp":"2024-12-18T19:43:45.808"},"format":"access violation: ${d}","data":{"d":"wasm memory out-of-bounds"}},{"context":{"level":"warn","file":"apply_context.cpp","line":134,"method":"exec_one","hostname":"","thread_name":"read-0","timestamp":"2024-12-18T19:43:45.809"},"format":"${receiver} <= ${account}::${action} pending console output: ${console}","data":{"console":"Im a payloadless slow action","account":"payloadless","action":"doitslow","receiver":"payloadless"}}]},"error_code":"10000000000000000000"}}

https://github.com/AntelopeIO/spring/actions/runs/12605899660/job/35135509220

@ericpassmore
Copy link
Contributor

Note:start
category: Test
component: Internal
summary: Fix spurious access violations to resolve failure in read-only transaction test.
Note:end

@bhazzard
Copy link

@spoonincode disable the test for v1.0.4. We'll create an issue to get the test working consistently for a future milestone.

@spoonincode
Copy link
Member

Test ended up being removed due to complications disabling it. Old test can be found at 90c11c3 for when we want to explore doing whatever is needed to get it rolling again

@spoonincode spoonincode moved this from Awaiting Review to Reviewer Approved in Team Backlog Jan 22, 2025
@github-project-automation github-project-automation bot moved this from Reviewer Approved to Done in Team Backlog Jan 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment