Radiuma_RnD/Luigi/README.md

Readme For Radiuma_Luigi

This section contains research and development (R&D) projects related to the Luigi tool. Luigi is a lightweight and simple workflow engine for building data and scientific pipelines that focuses on reproducibility and dependency management.

Project Goals

• Design simple and executable pipelines in the desktop environment
• Review Luigi's capabilities for managing dependencies and parallel execution
• Test the reproducibility of results and recording artifacts for scientific analysis
• Compare Luigi's performance with other tools (such as Galaxy and Dagster)

Folder Structure

• tasks/ → Contains codes related to task definitions
• examples/ → Simple examples for testing and execution
• logs/ → Outputs and logs related to pipeline execution
• README.md → General description of the project and how to run

How to run

1. Install Luigi:

pip install luigi
python run_pipeline.py RadiumaPipeline --local-scheduler