ovs-scheduled-tasks stops

[jtorreke]

Ovs-scheduled-tasks got stopped with the following stack trace:

2019-05-27 04:47:00 03000 -0400 - NY1SRV0019 - 27902/140255200474880 - celery/celery.beat - 1728688 - DEBUG - beat: Synchronizing schedule...
2019-05-27 04:47:00 03000 -0400 - NY1SRV0019 - 27902/140255200474880 - celery/celery beat - 1728689 - DEBUG - DS syncing schedule entries
2019-05-27 04:47:10 03100 -0400 - NY1SRV0019 - 27902/140255200474880 - extensions/volatilemutex.py - 258 - ERROR - Lock for ovs_lock_celery_beat could not be acquired. 10.0007228851 sec > 10 sec
2019-05-27 04:47:10 03200 -0400 - NY1SRV0019 - 27902/140255200474880 - celery/celery beat - 1728690 - DEBUG - DS syncing schedule entries
2019-05-27 04:47:20 03200 -0400 - NY1SRV0019 - 27902/140255200474880 - extensions/volatilemutex.py - 259 - ERROR - Lock for ovs_lock_celery_beat could not be acquired. 10.0003490448 sec > 10 sec
2019-05-27 04:47:20 03300 -0400 - NY1SRV0019 - 27902/140255200474880 - celery/celery.beat - 1728691 - CRITICAL - beat raised exception <class 'ovs_extensions.generic.volatilemutex.NoLockAvailableException'>: NoLockAvailableException('Could not acquire lock ovs_lock_celery_beat',)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/celery/apps/beat.py", line 112, in start_scheduler
    beat.start()
  File "/usr/lib/python2.7/dist-packages/celery/beat.py", line 490, in start
    self.sync()
  File "/usr/lib/python2.7/dist-packages/celery/beat.py", line 493, in sync
    self.scheduler.close()
  File "/usr/lib/python2.7/dist-packages/celery/beat.py", line 285, in close
    self.sync()
  File "/opt/OpenvStorage/ovs/celery_beat.py", line 117, in sync
    self._mutex.acquire(wait=10)
  File "/usr/lib/python2.7/dist-packages/ovs_extensions/generic/volatilemutex.py", line 77, in acquire
    raise NoLockAvailableException('Could not acquire lock {0}'.format(self.key()))
NoLockAvailableException: Could not acquire lock ovs_lock_celery_beat
Stopped Open vStorage scheduled tasks.