Task #4169
openTask #4163: [ce, ee] celery refactor + upgrade
re-architecture celery support
0%
Description
Currently celery is a mess. We need to re-think how to handle the celery workers inside our application.
we should plan around:
- start with fresh approach to celery, so we cen remove all the magic code we have now
- upgrade celery to latest version
- port our wrapper (ResultWrapper) on latest celery tasks code. This is to handle fallback execution (means execute sync when exceptions, or celery is down, or misconfigured connection to celery)
- think about paster celeryd, probably we should create new executable, or we keep it this way for backward compat
- We should design our new celery to make sure it has appl required registry items, as well as the pylons stuff so each task plays out nicely.
Few gotachas from old code.
- ResultWrapper to handle taks nicer than standard celery
- DBSession cleanups, on execution (the @dbsession decorator)
Updated by Marcin Kuzminski [CTO] about 8 years ago
- Target version changed from v4.4 to v4.5
Updated by Marcin Kuzminski [CTO] about 8 years ago
- Target version changed from v4.5 to v4.6
Updated by Marcin Kuzminski [CTO] almost 8 years ago
- Target version changed from v4.6 to v4.7
Updated by Marcin Kuzminski [CTO] over 7 years ago
- Target version changed from v4.7 to v4.10
Updated by Marcin Kuzminski [CTO] about 7 years ago
- Target version changed from v4.10 to v4.11
Updated by Marcin Kuzminski [CTO] about 7 years ago
- Status changed from New to In Progress
Updated by Redmine Integration about 7 years ago
- Status changed from In Progress to Resolved
Commit 8912a3e3bdea by Marcin Kuzminski marcin@rhodecode.com on default branch changed this issue. https://internal-code.rhodecode.com/rhodecode-enterprise-ce/changeset/8912a3e3bdeade55e9e16f6c5d05896ce752025b
Updated by Redmine Integration about 7 years ago
pullrequest created by marcink (status: under_review). https://internal-code.rhodecode.com/rhodecode-enterprise-ce/pull-request/2926
Updated by Redmine Integration about 7 years ago
Commit 246f5a4cf090 by Marcin Kuzminski marcin@rhodecode.com on default branch changed this issue. https://internal-code.rhodecode.com/rhodecode-enterprise-ce/changeset/246f5a4cf0901a179740d9cf04d131354ebef1d1
Updated by Redmine Integration about 7 years ago
Commit 246f5a4cf090 by Marcin Kuzminski marcin@rhodecode.com on default branch changed this issue. https://internal-code.rhodecode.com/rhodecode-enterprise-ce/changeset/246f5a4cf0901a179740d9cf04d131354ebef1d1
Updated by Redmine Integration about 7 years ago
pullrequest merged by marcink (status: approved). https://internal-code.rhodecode.com/rhodecode-enterprise-ce/pull-request/2926