You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Move db writer to a separate process with a single queue #32
Inserts that fail will be re-added to a retry queue along with a list of the errors, when that list for some doc becomes too large, stop the entire procedure since writes are failing.
Activity
robobenklein commentedon May 28, 2021
Inserts that fail will be re-added to a retry queue along with a list of the errors, when that list for some doc becomes too large, stop the entire procedure since writes are failing.
robobenklein commentedon Jul 16, 2021
This is a bad idea.
Don't use a single IPC queue for passing documents, performance is worse than my house connection to the DB...
Need some method to write documents from each worker in parallel, maybe FileLock is performant enough? Until then, manual checks on arango it is.