docs(proposal): add EP-003 for VM CPU Power Modeling for Kepler #2291
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Introduces enhancement proposal for adding Machine Learning models to estimate kepler power metrics in a Virtual Machine environment when hardware power measurement interfaces like RAPL are not available. Signed-off-by: Kaiyi Liu <[email protected]>
|
�[1m 🔆🔆🔆 Validating 🔆🔆🔆 �[0m
💻 CPU Comparison with base Kepler💾 Memory Comparison with base Kepler (Inuse)💾 Memory Comparison with base Kepler (Alloc)⬇️ Download the Profiling artifacts from the Actions Summary page 📦 Artifact name: 🔧 Or use GitHub CLI to download artifacts: gh run download 17207440019 -n profile-artifacts-2291 |
vimalk78
reviewed
Aug 28, 2025
|
|
||
| ## Problem Statement | ||
|
|
||
| Virtual machines lack direct access to hardware power measurement interfaces (RAPL, IPMI, etc.) that are essential for energy monitoring in cloud and virtualized environments. Current Kepler deployments in VMs cannot provide accurate power consumption estimates because they cannot access the underlying hardware power consumption data. This creates a significant gap in energy monitoring capabilities for the growing virtualized infrastructure landscape. |
There was a problem hiding this comment.
can we mention that PMU is usually disabled for VMs by providers, so VMs do not show any performance counter also.
| - **Primary Goal**: Develop zone-specific machine learning models (package, core, DRAM, uncore) for CPU power estimation in VMs | ||
| - **Secondary Goal**: Create a production-ready deployment system for VM power models in Go environments | ||
| - **Tertiary Goal**: Establish best practices for VM power modeling including CPU pinning and isolation requirements | ||
| - **Performance Goal**: Achieve <10% mean absolute percentage error compared to baremetal measurements |
There was a problem hiding this comment.
prefer RMS error over MAPE
| ### Functional Requirements | ||
|
|
||
| - **FR1**: Train separate ML models for each power zone (package, core, DRAM, uncore) | ||
| - **FR2**: Use only VM-accessible OS and memory counters as input features |
There was a problem hiding this comment.
code seems to show it, but pls add a section showing list of features used for model training.
| kepler_vm_last_training_timestamp{zone="package"} 1692984532 | ||
| ``` | ||
|
|
||
| ## Implementation Plan |
There was a problem hiding this comment.
typically enhancement proposals do not contain implementation plan.
There was a problem hiding this comment.
please add some detail about
- Model Architecture, mentioning model type (regression, neural network, xgboost etc.) with list of input features and feature engineering approach
- Training Data Requirements, mentioning training data source, if any preprocessing on data, training data size requirements
- how to detect/prevent model overfitting?
- hyperparameters
is there any dependence on number of vCPU? if not why, if yes what does this mean for model training/selection
consider a typical case of 128 CPU baremetal machine running multiple VMs, some with 4 vCPUs, some with 8 vCPUs
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Introduces enhancement proposal for adding Machine Learning models to estimate kepler power metrics in a Virtual Machine environment when hardware power measurement interfaces like RAPL are not available.