Assertion failed for xxx: RUNNING not in STARTING

[markcollister]

I have been seeing the following error, only happening when the processes i'm supervising are exiting often and I have supervisor set to auto restart. Happening about daily - with 5 processes all of which frequently exit (i.e. every few seconds)

Traceback (most recent call last):
  File "/usr/local/bin/supervisord", line 9, in <module>
    load_entry_point('supervisor==3.0', 'console_scripts', 'supervisord')()
  File "/usr/local/lib/python2.7/dist-packages/supervisor-3.0-py2.7.egg/supervisor/supervisord.py", line 360, in main
    go(options)
  File "/usr/local/lib/python2.7/dist-packages/supervisor-3.0-py2.7.egg/supervisor/supervisord.py", line 370, in go
    d.main()
  File "/usr/local/lib/python2.7/dist-packages/supervisor-3.0-py2.7.egg/supervisor/supervisord.py", line 83, in main
    self.run()
  File "/usr/local/lib/python2.7/dist-packages/supervisor-3.0-py2.7.egg/supervisor/supervisord.py", line 100, in run
    self.runforever()
  File "/usr/local/lib/python2.7/dist-packages/supervisor-3.0-py2.7.egg/supervisor/supervisord.py", line 254, in runforever
    self.reap()
  File "/usr/local/lib/python2.7/dist-packages/supervisor-3.0-py2.7.egg/supervisor/supervisord.py", line 288, in reap
    process.finish(pid, sts)
  File "/usr/local/lib/python2.7/dist-packages/supervisor-3.0-py2.7.egg/supervisor/process.py", line 455, in finish
    self._assertInState(ProcessStates.STARTING)
  File "/usr/local/lib/python2.7/dist-packages/supervisor-3.0-py2.7.egg/supervisor/process.py", line 179, in _assertInState
    self.config.name, current_state, allowable_states))
AssertionError: Assertion failed for orchestration_listings_solr: RUNNING not in STARTING

I also saw this when trying to figure out what was happening: https://lists.supervisord.org/pipermail/supervisor-users/2012-July/001111.html

Cheers

[vrnagy]

Hi,

We are expirencing exactly the same error as You.
Do You managed to solve the problem?

Thanks

[markcollister]

Hi

Not really, I ended up reworking the apps that supervisor was managing, so that rather than exiting frequently they stayed up for a set amount of time

Cheers