soorena62
23 lines
990 B
Markdown
23 lines
990 B
Markdown
# Readme For ***Radiuma_Luigi***
|
|
|
|
This section contains research and development (R&D) projects related to the **Luigi** tool.
|
|
Luigi is a lightweight and simple workflow engine for building data and scientific pipelines that focuses on reproducibility and dependency management.
|
|
|
|
## Project Goals
|
|
- Design simple and executable pipelines in the desktop environment
|
|
- Review Luigi's capabilities for managing dependencies and parallel execution
|
|
- Test the reproducibility of results and recording artifacts for scientific analysis
|
|
- Compare Luigi's performance with other tools (such as Galaxy and Dagster)
|
|
|
|
## Folder Structure
|
|
- `tasks/` → Contains codes related to task definitions
|
|
- `examples/` → Simple examples for testing and execution
|
|
- `logs/` → Outputs and logs related to pipeline execution
|
|
- `README.md` → General description of the project and how to run
|
|
|
|
## How to run
|
|
1. Install Luigi:
|
|
```bash
|
|
pip install luigi
|
|
python run_pipeline.py RadiumaPipeline --local-scheduler
|