Skip to content

Simplify the collection, printing, and saving of model metrics in ML.NET #1

Description

@atkinsonbg

Hackathon Idea

Please fill out this form to submit an idea for the Virtual ML.NET Hackathon

Your name

Brandon Atkinson (github.com/atkinsonbg)
Nathaniel Brumbach (github.com/Extrabeefy)

Team name

Practical ML.NET User Group Team

Brief Description

Simplify the collection, printing, and saving of model metrics in ML.NET. Take the following line:

var modelMetrics = mlContext.Regression.Evaluate(testSetTransform);

We would take the 'modelMetrics' object and print each property out or parse it out to a file. This is tedious code to write every time a model is created. We would like to simplify this down to a single line to, for instance:

MLContext.Regression.Metrics()

We also plan to include the permutation feature importance in this output: https://docs.microsoft.com/en-us/dotnet/machine-learning/how-to-guides/explain-machine-learning-model-permutation-feature-importance-ml-net

Other

Are you looking for team members?

  • Yes
  • No

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions