8 Commits

Author SHA1 Message Date
Tuan-Dat Tran
5785827899 feat(simulation): Ran simulation with 1000
Signed-off-by: Tuan-Dat Tran <tuan-dat.tran@tudattr.dev>
2024-11-28 16:01:52 +01:00
Tuan-Dat Tran
f9d48e6fe4 fix(simulation): Evaluation of age was based on hits instead of access_count
Signed-off-by: Tuan-Dat Tran <tuan-dat.tran@tudattr.dev>
2024-11-28 15:57:19 +01:00
Tuan-Dat Tran
a484d49128 fix(simulation): enhance client request process with progress tracking and refine metrics computation
- Added `tqdm` progress bar to track simulation progress in real-time.
- Improved computation of hit rates and average ages for better accuracy.
- Updated data export logic for clearer output and better insights.
Reran Experiments

Signed-off-by: Tuan-Dat Tran <tuan-dat.tran@tudattr.dev>
2024-11-28 15:21:56 +01:00
Tuan-Dat Tran
43b84bf0bb feat(eval): add markdown export for hit rates and average ages
- Introduced functionality to export hit rates and average ages as markdown files.
- Generated `hit_rates.md` and `avg_ages.md` for easier sharing and reporting.

Signed-off-by: Tuan-Dat Tran <tuan-dat.tran@tudattr.dev>
2024-11-28 11:40:56 +01:00
Tuan-Dat Tran
09b943e41d fix(simulation): correct exponential sampling and cache behavior logic
- Fixed incorrect use of exponential sampling for `next_request` and `next_refresh` timings.
- Adjusted cache eviction logic to properly handle capacity checks.
- Improved simulation output and logging for least accessed objects.
- Corrected CSV export to include index labels for better data clarity.
- Reran experiments

Signed-off-by: Tuan-Dat Tran <tuan-dat.tran@tudattr.dev>
2024-11-28 11:19:04 +01:00
Tuan-Dat Tran
dea6004160 feat(cache-simulation): add avg_age metric and update TTL experiment name
- Introduced `avg_age` metric to track the average age of cached objects during simulation.
- Updated experiment configuration name from "No Refresh (0.5s ttl)" to "No Refresh (5.0s ttl)".
- Updated Jupyter notebooks and related files to incorporate new metrics and change experiment labels.
- Modified experiment output CSV and PDF files to reflect the new `avg_age` metric and updated experiment details.

Signed-off-by: Tuan-Dat Tran <tuan-dat.tran@tudattr.dev>
2024-11-27 17:34:04 +01:00
Tuan-Dat Tran
b540aafc61 feat: add new experiment notebook and visualization
- Added `aoi_cache_experiment_eval.ipynb`: A Jupyter notebook evaluating cache performance based on TTL (Time-to-Live) with hit rate and average age analysis. It includes visualizations and experiment results.
- Removed the unused `experiment_name` variable in `aoi_cache_simulation.ipynb`.
- Added `experiments/hr_and_age_vs_ttl.png`: A plot visualizing the relationship between hit rate and TTL, complementing the cache evaluation experiments.

### Reason
The new notebook enhances experiment evaluation by providing a detailed analysis of cache behavior over different TTL values. The image file adds a visualization of the results. The removal of the `experiment_name` variable cleans up the simulation code, as it was not being utilized.

Signed-off-by: Tuan-Dat Tran <tuan-dat.tran@tudattr.dev>
2024-11-27 16:59:06 +01:00
Tuan-Dat Tran
673302a6b2 feat: add new experiment notebook and visualization
- Added `aoi_cache_experiment_eval.ipynb`: A Jupyter notebook evaluating cache performance based on TTL (Time-to-Live) with hit rate and average age analysis. It includes visualizations and experiment results.
- Removed the unused `experiment_name` variable in `aoi_cache_simulation.ipynb`.
- Added `experiments/hr_and_age_vs_ttl.png`: A plot visualizing the relationship between hit rate and TTL, complementing the cache evaluation experiments.

### Reason
The new notebook enhances experiment evaluation by providing a detailed analysis of cache behavior over different TTL values. The image file adds a visualization of the results. The removal of the `experiment_name` variable cleans up the simulation code, as it was not being utilized.

Signed-off-by: Tuan-Dat Tran <tuan-dat.tran@tudattr.dev>
2024-11-27 16:58:54 +01:00