Description
This library provides an abstraction to perform Model Versioning using Weight & Biases.
Features
- Version a new trained model
- Promote a model to another stage (e.g production)
Example of usage
The following code snippet shows how to promote a newly trained model to the best_model on the validation set. First, it creates the model providing the checkpoint path, the artifact name and type, a description, and the metadata, where the metrics or any desired information is stored.
The comparision_type indicates how to compare the metrics between the two models. E.g if smaller, the smaller the metric from the new model the better
run = wandb.init(...)
# Create the desired artifact
artifact = versioner.create_artifact(
checkpoint='model.ckpt',
artifact_name='prueba',
artifact_type='model',
description='Prueba Wandb-MV',
metadata={
'val_metric': 78.0,
'test_metric': 0.0
})
# Promote the desired artifact to the 'best_model' tag
versioner.promote_model(new_model=artifact,
artifact_name='prueba',
artifact_type='model',
comparision_metric='val_metric',
promotion_alias='best_model',
comparision_type='smaller'
)
This code snippet shows how to promote a trained model to production after being validated on the test set. The already_deployed parameter indicates that the model is already logged, so it only needs to be updated.
versioner = Versioner(run)
versioner.promote_model(new_model=artifact,
artifact_name='prueba',
artifact_type='model',
comparision_metric='test_metric',
promotion_alias='production',
comparision_type='smaller',
already_deployed=True
)
Next features
- Allow providing a custom comparision function to promote a model
- ...
1 May 17, 2022
19 Jan 07, 2023
5 Nov 18, 2021
2 Sep 29, 2022
4k Dec 30, 2022
5 Oct 18, 2022
551 Dec 31, 2022
14 Dec 28, 2022
120 Dec 30, 2022
11 Dec 30, 2022
185 Dec 24, 2022
0 Jan 08, 2022
3 Oct 15, 2021
17 Oct 17, 2022
2 May 27, 2022
365 Dec 31, 2022
8 Oct 06, 2022
1 Feb 14, 2022
94 Dec 03, 2022
684 Nov 02, 2022