multiline: ruby: support built-in ruby parser #6169

nokute78 · 2022-10-10T12:10:01Z

Fixes #6050

This patch is to support multiline parser for ruby backtrace.

Enter [N/A] in the box, if an item is not applicable to your change.

Testing
Before we can approve your change; please submit the following in a comment:

Example configuration file for the change
Debug log output from testing the change

Attached Valgrind output that shows no leaks or memory corruption was found

If this is a change to packaging of containers or native binaries then please confirm it works for all targets.

[N/A] Attached local packaging test output showing all targets (including any new ones) build.

Documentation

Documentation required for this feature

Backporting

[N/A] Backport to latest stable release.

Configuration

[INPUT]
    Name tail
    path a.log
    Read_From_Head on
    multiline.parser ruby

[OUTPUT]
    Name stdout
    Match *

a.log:

This log was generated invalid ruby on rails application.

ruby 3.0.2p107
Rails 7.0.4

rails new backtrace_test
modify config/routes.rb. Add a = 10 /0
rails server

/home/taka/backtrace_test/config/routes.rb:6:in `/': divided by 0 (ZeroDivisionError)
	from /home/taka/backtrace_test/config/routes.rb:6:in `block in <main>'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:428:in `instance_exec'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:428:in `eval_block'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:410:in `draw'
	from /home/taka/backtrace_test/config/routes.rb:1:in `<main>'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `load'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `block in load_paths'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `each'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `load_paths'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:24:in `reload!'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:38:in `block in updater'
	from /var/lib/gems/3.0.0/gems/activesupport-7.0.4/lib/active_support/file_update_checker.rb:83:in `execute'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:13:in `execute'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/finisher.rb:158:in `block in <module:Finisher>'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:32:in `instance_exec'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:32:in `run'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:61:in `block in run_initializers'
	from /usr/lib/ruby/3.0.0/tsort.rb:228:in `block in tsort_each'
	from /usr/lib/ruby/3.0.0/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:431:in `each_strongly_connected_component_from'
	from /usr/lib/ruby/3.0.0/tsort.rb:349:in `block in each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `each'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `call'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:226:in `tsort_each'
	from /usr/lib/ruby/3.0.0/tsort.rb:205:in `tsort_each'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:60:in `run_initializers'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application.rb:372:in `initialize!'
	from /home/taka/backtrace_test/config/environment.rb:5:in `<main>'
	from config.ru:3:in `require_relative'
	from config.ru:3:in `block in <main>'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:116:in `eval'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:116:in `new_from_string'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:105:in `load_file'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:66:in `parse_file'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:349:in `build_app_and_options_from_config'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:249:in `app'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:422:in `wrapped_app'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:76:in `log_to_stdout'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:36:in `start'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:143:in `block in perform'
	from <internal:kernel>:90:in `tap'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:134:in `perform'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor/command.rb:27:in `run'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor/invocation.rb:127:in `invoke_command'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor.rb:392:in `dispatch'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/command/base.rb:87:in `perform'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/command.rb:48:in `invoke'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands.rb:18:in `<main>'
	from /var/lib/gems/3.0.0/gems/bootsnap-1.13.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:32:in `require'
	from /var/lib/gems/3.0.0/gems/bootsnap-1.13.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:32:in `require'
	from bin/rails:4:in `<main>'
aaa
/home/taka/backtrace_test/config/routes.rb:6:in `/': divided by 0 (ZeroDivisionError)
	from /home/taka/backtrace_test/config/routes.rb:6:in `block in <main>'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:428:in `instance_exec'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:428:in `eval_block'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:410:in `draw'
	from /home/taka/backtrace_test/config/routes.rb:1:in `<main>'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `load'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `block in load_paths'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `each'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `load_paths'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:24:in `reload!'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:38:in `block in updater'
	from /var/lib/gems/3.0.0/gems/activesupport-7.0.4/lib/active_support/file_update_checker.rb:83:in `execute'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:13:in `execute'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/finisher.rb:158:in `block in <module:Finisher>'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:32:in `instance_exec'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:32:in `run'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:61:in `block in run_initializers'
	from /usr/lib/ruby/3.0.0/tsort.rb:228:in `block in tsort_each'
	from /usr/lib/ruby/3.0.0/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:431:in `each_strongly_connected_component_from'
	from /usr/lib/ruby/3.0.0/tsort.rb:349:in `block in each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `each'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `call'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:226:in `tsort_each'
	from /usr/lib/ruby/3.0.0/tsort.rb:205:in `tsort_each'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:60:in `run_initializers'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application.rb:372:in `initialize!'
	from /home/taka/backtrace_test/config/environment.rb:5:in `<main>'
	from config.ru:3:in `require_relative'
	from config.ru:3:in `block in <main>'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:116:in `eval'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:116:in `new_from_string'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:105:in `load_file'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:66:in `parse_file'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:349:in `build_app_and_options_from_config'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:249:in `app'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:422:in `wrapped_app'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:76:in `log_to_stdout'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:36:in `start'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:143:in `block in perform'
	from <internal:kernel>:90:in `tap'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:134:in `perform'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor/command.rb:27:in `run'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor/invocation.rb:127:in `invoke_command'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor.rb:392:in `dispatch'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/command/base.rb:87:in `perform'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/command.rb:48:in `invoke'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands.rb:18:in `<main>'
	from /var/lib/gems/3.0.0/gems/bootsnap-1.13.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:32:in `require'
	from /var/lib/gems/3.0.0/gems/bootsnap-1.13.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:32:in `require'
	from bin/rails:4:in `<main>'

Debug/Valgrind output

$ ../../bin/fluent-bit -c a.conf 
Fluent Bit v2.0.0
* Copyright (C) 2015-2022 The Fluent Bit Authors
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2022/10/10 21:08:53] [ info] [fluent bit] version=2.0.0, commit=130acf743d, pid=2925
[2022/10/10 21:08:53] [ info] [storage] ver=1.2.0, type=memory, sync=normal, checksum=off, max_chunks_up=128
[2022/10/10 21:08:53] [ info] [cmetrics] version=0.5.2
[2022/10/10 21:08:53] [ info] [input:tail:tail.0] initializing
[2022/10/10 21:08:53] [ info] [input:tail:tail.0] storage_strategy='memory' (memory only)
[2022/10/10 21:08:53] [ info] [input:tail:tail.0] multiline core started
[2022/10/10 21:08:53] [ info] [sp] stream processor started
[2022/10/10 21:08:53] [ info] [input:tail:tail.0] inotify_fs_add(): inode=4596361 watch_fd=1 name=a.log
[2022/10/10 21:08:53] [ info] [output:stdout:stdout.0] worker #0 started
[0] tail.0: [1665403733.856689612, {"log"=>"/home/taka/backtrace_test/config/routes.rb:6:in `/': divided by 0 (ZeroDivisionError)
	from /home/taka/backtrace_test/config/routes.rb:6:in `block in <main>'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:428:in `instance_exec'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:428:in `eval_block'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:410:in `draw'
	from /home/taka/backtrace_test/config/routes.rb:1:in `<main>'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `load'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `block in load_paths'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `each'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `load_paths'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:24:in `reload!'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:38:in `block in updater'
	from /var/lib/gems/3.0.0/gems/activesupport-7.0.4/lib/active_support/file_update_checker.rb:83:in `execute'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:13:in `execute'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/finisher.rb:158:in `block in <module:Finisher>'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:32:in `instance_exec'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:32:in `run'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:61:in `block in run_initializers'
	from /usr/lib/ruby/3.0.0/tsort.rb:228:in `block in tsort_each'
	from /usr/lib/ruby/3.0.0/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:431:in `each_strongly_connected_component_from'
	from /usr/lib/ruby/3.0.0/tsort.rb:349:in `block in each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `each'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `call'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:226:in `tsort_each'
	from /usr/lib/ruby/3.0.0/tsort.rb:205:in `tsort_each'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:60:in `run_initializers'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application.rb:372:in `initialize!'
	from /home/taka/backtrace_test/config/environment.rb:5:in `<main>'
	from config.ru:3:in `require_relative'
	from config.ru:3:in `block in <main>'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:116:in `eval'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:116:in `new_from_string'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:105:in `load_file'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:66:in `parse_file'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:349:in `build_app_and_options_from_config'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:249:in `app'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:422:in `wrapped_app'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:76:in `log_to_stdout'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:36:in `start'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:143:in `block in perform'
	from <internal:kernel>:90:in `tap'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:134:in `perform'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor/command.rb:27:in `run'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor/invocation.rb:127:in `invoke_command'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor.rb:392:in `dispatch'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/command/base.rb:87:in `perform'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/command.rb:48:in `invoke'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands.rb:18:in `<main>'
	from /var/lib/gems/3.0.0/gems/bootsnap-1.13.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:32:in `require'
	from /var/lib/gems/3.0.0/gems/bootsnap-1.13.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:32:in `require'
	from bin/rails:4:in `<main>'
"}]
[1] tail.0: [1665403733.856689612, {"log"=>"aaa
"}]
[0] tail.0: [1665403733.857254934, {"log"=>"/home/taka/backtrace_test/config/routes.rb:6:in `/': divided by 0 (ZeroDivisionError)
	from /home/taka/backtrace_test/config/routes.rb:6:in `block in <main>'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:428:in `instance_exec'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:428:in `eval_block'
	from /var/lib/gems/3.0.0/gems/actionpack-7.0.4/lib/action_dispatch/routing/route_set.rb:410:in `draw'
	from /home/taka/backtrace_test/config/routes.rb:1:in `<main>'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `load'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `block in load_paths'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `each'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:50:in `load_paths'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:24:in `reload!'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:38:in `block in updater'
	from /var/lib/gems/3.0.0/gems/activesupport-7.0.4/lib/active_support/file_update_checker.rb:83:in `execute'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/routes_reloader.rb:13:in `execute'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application/finisher.rb:158:in `block in <module:Finisher>'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:32:in `instance_exec'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:32:in `run'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:61:in `block in run_initializers'
	from /usr/lib/ruby/3.0.0/tsort.rb:228:in `block in tsort_each'
	from /usr/lib/ruby/3.0.0/tsort.rb:350:in `block (2 levels) in each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:431:in `each_strongly_connected_component_from'
	from /usr/lib/ruby/3.0.0/tsort.rb:349:in `block in each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `each'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `call'
	from /usr/lib/ruby/3.0.0/tsort.rb:347:in `each_strongly_connected_component'
	from /usr/lib/ruby/3.0.0/tsort.rb:226:in `tsort_each'
	from /usr/lib/ruby/3.0.0/tsort.rb:205:in `tsort_each'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/initializable.rb:60:in `run_initializers'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/application.rb:372:in `initialize!'
	from /home/taka/backtrace_test/config/environment.rb:5:in `<main>'
	from config.ru:3:in `require_relative'
	from config.ru:3:in `block in <main>'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:116:in `eval'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:116:in `new_from_string'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:105:in `load_file'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/builder.rb:66:in `parse_file'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:349:in `build_app_and_options_from_config'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:249:in `app'
	from /var/lib/gems/3.0.0/gems/rack-2.2.4/lib/rack/server.rb:422:in `wrapped_app'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:76:in `log_to_stdout'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:36:in `start'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:143:in `block in perform'
	from <internal:kernel>:90:in `tap'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands/server/server_command.rb:134:in `perform'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor/command.rb:27:in `run'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor/invocation.rb:127:in `invoke_command'
	from /var/lib/gems/3.0.0/gems/thor-1.2.1/lib/thor.rb:392:in `dispatch'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/command/base.rb:87:in `perform'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/command.rb:48:in `invoke'
	from /var/lib/gems/3.0.0/gems/railties-7.0.4/lib/rails/commands.rb:18:in `<main>'
	from /var/lib/gems/3.0.0/gems/bootsnap-1.13.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:32:in `require'
	from /var/lib/gems/3.0.0/gems/bootsnap-1.13.0/lib/bootsnap/load_path_cache/core_ext/kernel_require.rb:32:in `require'
	from bin/rails:4:in `<main>'
"}]
^C[2022/10/10 21:09:01] [engine] caught signal (SIGINT)
[2022/10/10 21:09:01] [ warn] [engine] service will shutdown in max 5 seconds
[2022/10/10 21:09:01] [ info] [input] pausing tail.0
[2022/10/10 21:09:01] [ info] [engine] service has stopped (0 pending tasks)
[2022/10/10 21:09:01] [ info] [input] pausing tail.0
[2022/10/10 21:09:01] [ info] [input:tail:tail.0] inotify_fs_remove(): inode=4596361 watch_fd=1
[2022/10/10 21:09:01] [ info] [output:stdout:stdout.0] thread worker #0 stopping...
[2022/10/10 21:09:01] [ info] [output:stdout:stdout.0] thread worker #0 stopped

Fluent Bit is licensed under Apache 2.0, by submitting this pull request I understand that this code will be released under the terms of that license.

Signed-off-by: Takahiro Yamashita <nokute78@gmail.com>

patrick-stephens · 2022-10-10T15:02:21Z

@nokute78 I think this does need a docs update to add ruby back into the list once merged.

nokute78 · 2022-10-13T12:09:09Z

@patrick-stephens I sent a patch fluent/fluent-bit-docs#932

nokute78 added 2 commits October 10, 2022 21:00

tests: internal: ml: add test for ruby multiline

4837c9a

Signed-off-by: Takahiro Yamashita <nokute78@gmail.com>

multiline: ruby: support ruby parser

e600e99

Signed-off-by: Takahiro Yamashita <nokute78@gmail.com>

nokute78 requested review from edsiper, leonardo-albertovich, fujimotos and koleini as code owners October 10, 2022 12:10

github-actions bot added the docs-required label Oct 10, 2022

nokute78 temporarily deployed to pr October 10, 2022 12:10 Inactive

nokute78 temporarily deployed to pr October 10, 2022 12:26 Inactive

edsiper merged commit 58d44a4 into fluent:master Oct 10, 2022

nokute78 deleted the ruby_parser branch October 13, 2022 11:59

nokute78 mentioned this pull request Oct 13, 2022

pipeline: filters: multiline-stacktrace: add ruby support fluent/fluent-bit-docs#932

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

multiline: ruby: support built-in ruby parser #6169

multiline: ruby: support built-in ruby parser #6169

nokute78 commented Oct 10, 2022

patrick-stephens commented Oct 10, 2022

nokute78 commented Oct 13, 2022

multiline: ruby: support built-in ruby parser #6169

multiline: ruby: support built-in ruby parser #6169

Conversation

nokute78 commented Oct 10, 2022

Configuration

Debug/Valgrind output

patrick-stephens commented Oct 10, 2022

nokute78 commented Oct 13, 2022