Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The features metrics pipeline running with the cron tasks isn't implemented as intended #124

Open
2 tasks
sinnec opened this issue Feb 8, 2023 · 2 comments
Assignees
Labels
bug Something isn't working good first issue Good for newcomers

Comments

@sinnec
Copy link
Contributor

sinnec commented Feb 8, 2023

The features metrics pipeline running with the cron tasks isn't implemented as intended. It uses inferences while it should be using training datasets and should run when a training dataset is inserted and not in cron tasks.

Note: The current implementation could be used for data quality metrics.

Tasks:

  • Calculate feature metrics when a training dataset is inserted.
  • Rename all model integrity functions, properties etc so the use the same name (model integrity metrics, feature metrics or descriptive statistics)
@momegas momegas added the bug Something isn't working label Feb 15, 2023
@momegas momegas changed the title Features metrics pipeline The features metrics pipeline running with the cron tasks isn't implemented as intended Feb 15, 2023
@momegas momegas added the good first issue Good for newcomers label Feb 15, 2023
@stavrostheocharis
Copy link
Contributor

stavrostheocharis commented Feb 15, 2023

async def run calculate feature metrics pi
For now, let’s use it for processed training data. For inferences let’s keep it for a new feature.

@stavrostheocharis
Copy link
Contributor

For the name let's use the "descriptive statistics" where we use integrity, etc.:
class FeatureMetrics(BaseModel)
return Nond

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

4 participants