You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Is your feature request related to a problem? Please describe.
NA
Describe the solution you'd like
For reliability, it is essential to evaluate the models on various OOD sets or adversarial/manual attacks. There are some challenges associated with this:
Support device-specific computing for the model in the loop.
Each dataset requires its own data augmentation tricks.
Describe alternatives you've considered
It is easy to add manual attacks or data augmentation strategies. However, model-in-the-loop requires additional infra changes.
Additional context
NA
The text was updated successfully, but these errors were encountered:
Is your feature request related to a problem? Please describe.
NA
Describe the solution you'd like
For reliability, it is essential to evaluate the models on various OOD sets or adversarial/manual attacks. There are some challenges associated with this:
Describe alternatives you've considered
It is easy to add manual attacks or data augmentation strategies. However, model-in-the-loop requires additional infra changes.
Additional context
NA
The text was updated successfully, but these errors were encountered: