Cannot allocate memory Error

[junjchen]

Hi,

I am getting Errno::ENOMEM: Cannot allocate memory errors when trying to use this gem to decrypt text from a large size dataset. The data set contains 25k rows and this error started to appear after processing around 11k rows.

Container running the worker still has a lot of unused RAM so I dont believe system memory is the issue here. I also tried setting auto-expand-secmem in .gnupg/gpg-agent.conf but it didnt help either.

Would really appreciate if anyone can provide a direction as to what could have caused this issue.

Error stack

/usr/src/app/vendor/bundle/ruby/2.7.0/gems/gpgme-2.0.20/lib/gpgme/ctx.rb:435:in `decrypt_verify'
/usr/src/app/vendor/bundle/ruby/2.7.0/gems/gpgme-2.0.20/lib/gpgme/crypto.rb:172:in `block in decrypt'
/usr/src/app/vendor/bundle/ruby/2.7.0/gems/gpgme-2.0.20/lib/gpgme/ctx.rb:79:in `new'
/usr/src/app/vendor/bundle/ruby/2.7.0/gems/gpgme-2.0.20/lib/gpgme/crypto.rb:170:in `decrypt'