VSN-2680 : Introducing new approach of documents processing background launching via Celery & Redis as a backend + broker & Defining dockerfile-worker to build the celery application.
Merge Request Description
This merge request introduces several validations and improvements related to background task processing, configuration management, and Celery integration. Below is a semantic description of each commit, ordered chronologically.
feat: Initializing celery + tasks definition
This commit sets up the initial integration of Celery into the project. It defines the basic tasks and establishes the foundation for asynchronous background processing.
refactor: Introducing celery initiator
This commit refactors the codebase to include a dedicated initiator for Celery. It ensures that task initialization is handled in a structured and consistent manner.
feat: Implementing background task
This commit introduces the first implementation of background task execution. It leverages Celery to run processes asynchronously, improving scalability and responsiveness.
refactor: Rectifying processing controller
This commit refactors the processing controller to align with the new background task architecture. It corrects logic inconsistencies and ensures smooth orchestration of task execution.
refactor: Adding external call
This commit adds support for external service calls within the processing flow. It ensures that background tasks can interact with external systems in a reliable and maintainable way.
refactor: Externalizing configs
This commit moves configuration values out of the core codebase into externalized configuration files. This improves maintainability, flexibility, and environment-specific customization.
feat: Introducing docker-worker file
This commit introduces a dedicated Dockerfile for the Celery worker. It defines the build process for the worker container, ensuring proper isolation and orchestration with Redis as the backend and broker.
Closes VSN-2680