Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fixes for multithreaded execution #156

Closed
wants to merge 8 commits into from
Closed

Conversation

jacquelinekay
Copy link
Contributor

Known issues:

to reproduce:

./build/test_rclcpp/gtest_multithreaded__rmw_opensplice_cpp --gtest_filter=*publisher_intra_process --gtest_repeat=-1

Issues only seem to occur in Opensplice in the intra process test cases, and much more frequently in the multi_access_publisher_intra_process case.

  • AnyExecutable occasionally gets garbage in a few of its shared_ptr fields.
timer: {_M_ptr = 0x106cbf8, _M_refcount = {_M_pi = 0x106cbe0}}, <No data fields>}
subscription: {_M_ptr = 0x0, _M_refcount = {_M_pi = 0x2}}, <No data fields>}
subscription_intra_process: {_M_ptr = 0x100003b31, _M_refcount = {_M_pi = 0x0}}

It looks to me like:
timer is a valid shared_ptr. The pointer value changes between runs but it always looks like a valid shared_ptr.
subscription is a null pointer with a refcount of 2 (not good). These values stay the same in every occurrence of the bug.
subscription_intra_process is an invalid pointer (value evaluates to 2^32+15153 in decimal) with no ref count. The ref count is always 0, the pointer value changes between runs (but it's always over 2^32 aka 0x100000000).

Timer is not always set, sometimes the error occurs when the any_executable already has null ptr fields and it's trying to set subscription. However, it segfaults because it sees that subscription has a non-zero refcount and tries to release already null memory.

  • Random deadlock.
  • Random segfaults due to ownership issues of an rmw_guard_condition (probably have to extend locking of the interrupt_guard_condition in Executor).

@jacquelinekay jacquelinekay added the in progress Actively being worked on (Kanban column) label Nov 18, 2015
@esteve
Copy link
Member

esteve commented Nov 18, 2015

in progress. don't look here!

Too late! What should I do now?

@jacquelinekay
Copy link
Contributor Author

Now that you've looked at this issue, you have to help me fix it! Bwahahaha!

@jacquelinekay jacquelinekay added in review Waiting for review (Kanban column) in progress Actively being worked on (Kanban column) and removed in progress Actively being worked on (Kanban column) in review Waiting for review (Kanban column) labels Nov 19, 2015
@jacquelinekay jacquelinekay removed the in progress Actively being worked on (Kanban column) label Dec 2, 2015
@jacquelinekay jacquelinekay deleted the multithreaded branch December 8, 2015 01:14
DensoADAS pushed a commit to DensoADAS/rclcpp that referenced this pull request Aug 5, 2022
* ros2GH-138 Move calculation of bag size

- previously in rosbag2::Info
- now in storage plugin

* ros2GH-130 Add rosbag2_bag_v2_plugins package

-This package will contain storage and converter plugins

* ros2GH-131 don't build plugins on Windows

* ros2GH-129 Add function to be generated

- massive if/else between all message types
- will be generated similar to ros1_bridge plugin

* ros2GH-138 Write storage plugin for rosbag v2 bags

* ros2GH-138 Make sure that no attempt to create a converter is made when trying to read a rsbag v2 bag file

* ros2GH-138 Add play end-to-end test for rosbag v2 plugin

* ros2GH-138 Use cmake files to find ros1 packages

- Use files from ros1_bridge via PkgConfig

* ros2GH-138 Add generator code

* ros2GH-141 Add initial version of vendor package

* ros2GH-141 Improve vendor package to build on Mac

* ros2GH-138 Cleanup CMakeLists

* ros2GH-141 Use unmanaged Instance of class-loader

- managed instance somehow isn't available for gcc 6.3

* ros2GH-141 Reduce patch and copy new toplevle CMakeLists by hand

* ros2GH-141 Fix Shared Instance usage

* ros2GH-141 Improve maintainability of vendor package

- Document what patches do and why changes are necessary
- Load ros1 packages through cmake macro
- Do not export ros1 packages via ament
- use commit hash of current master which is more stable than using melodic-devel

* ros2GH-138 Link against rclcpp - necessary for ros1_bridge

* ros2GH-138 Avoid crash when trying to play v2 bags which contain unknown message types

* ros2GH-138 Add CLI -s <storage_id> option to ros2 bag info and use it in rosbag2::info

- this allows ros2 bag info to work also when the yaml metadata file does not exsist
- this is always the case for rosbag1 bagfiles
- it could also happen for sqlite or other storage based bagfiles

* ros2GH-138 Add end-to-end info test for rosbag v2 files

* ros2GH-138 Add unit tests to rosbag_storage

* ros2GH-138 Add method to extract filename from path to FilesystemHelpers

* ros2GH-138 Add proper logging for topics which cannot be converted

* ros2GH-138 Improve finding dependencies of ros1

* ros2GH-141 Explicitly import transitive dependencies of vendor package

* ros2GH-138 Skip tests via ament if ros1 is not available

* ros2GH-133 First split of plugins

* ros2GH-133 Write serialized rosbag message

* ros2GH-133 Improve converter plugin

- move generation templates outside of plugin folders as both
  plugins need it
- use ros::serialization routines to deserialize the ros message

* ros2GH-133 Add plugin to be found by pluginlib

* ros2GH-133 Remove empty check in converter

- With the rosbag_v2_converter_plugin, we don't need to treat
  rosbag_v2 storage any different

* ros2GH-133 Assert serialization format in unit tests for storage

* ros2GH-133 Delete superfluous include folder

- Only needed if we want to link against the library

* ros2GH-133 get_all_topics_and_types returns only valid ros2 types

- This is necessary as the information is used by rosbag2_transport
- ros2 bag info still shows all topics and types
- rosbag::View::getConnections() can return multiple connections corresponding to the same topic

* ros2GH-133 Improve end to end test

- use a bagfile with messages not known to ros2

* ros2GH-133 Reformulate info message in case of missing ros1-ros2 mapping for a topic

* ros2GH-14 Find messages first

* Explicitly print message when on Windows

Co-Authored-By: Martin-Idel-SI <external.Martin.Idel@bosch-si.com>

* ros2GH-14 Refactor rosbag_storage vendor package

- Improve toplevel CMakeLists
- Put all patches into a resource subfolder

* ros2GH-14 Reflect renames of converter interfaces

* ros2GH-156 Workaround for path problems

* ros2GH-156 Add documentation for plugin

* ros2GH-156 Fix the pluginlib version to greater 2

* ros2GH-156 Prohibit CMake from declaring paths as system paths

This switches the order of ros2 and ros1 directories
resulting in build failures

* ros2GH-156 Prohibit system include paths for rosbag plugins

This can lead to switching ros1 and ros2 include paths resulting
in missing symbols as the wrong pluginlib gets included

* ros2GH-14 Split patches

* make README more verbose

* add plugin specific readme

* more readme for bag_v2 plugin
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants