Survey of user's perceptions of model cards

1. Purpose of Research Study
This study aims to understand users' perceptions of model cards in Hugging Face, including the quality of model cards and the effect of high/low-quality model cards. 
Therefore, in this survey, we sincerely invite you to fill out the questionnaire to gain your genuine insights.
2. Benefits of Study
The content of a model card, whether overly complex or lacking important information, can cause confusion for users, and may influence the choice of models. Your responses in this experiment will provide valuable insights for future model card editing and model card improving.
3. Contact Details:
The questionnaire is anonymous and will take approximately 10 minutes of your time. It does not involve any personal privacy. If you have any questions or suggestions regarding the questionnaire, please contact hanjx@hzcu.edu.cn or junxiaohan@zju.edu.cn.
Part One. Demographics
*
1.

Do you use models published on the Hugging Face platform?

Yes
No
*
2.
Which of the following roles can best describe your software experience?
Software Development
Software Testing
Project Management
Others
*
3.
How many years of experience do you have with your current job role? (decimals OK)
*
4.
How many model cards have you roughly read?
1-20
11-20
21-30
More Than 30
Part Two. Survey about user's perceptions of model cards
*
5.
Have you ever paid attention to the quality of Model Cards?
Yes
No
*
6.
How satisfied are you with the quality of model cards you have ever read?
Very Satisfied
Satisfied
Neutral
Dissatisfied
Very Dissatisfied
*
7.
What information do you prefer the model cards to provide? (multiple choice OK)【多选题】
Model Description (A concise introduction to the model)
Intended Use (Direct purpose of building the model)
Training Data (Data used during training the model)
Performance Metrics (Evaluation of the model)
Ethical Considerations (Potential issues during model usage)
Limitations (The inherent limitations of the model itself)
Licensing Information (The information of license)
Example Code (The example of how to use/download the model)
Other (please specify)
*
8.
The following are the seven categories we have identified for the content of model cards, what do you think are the most important categories in the model card? (multiple choice OK)【多选题】
What (Including sections of model introduction such as Model Description, Model Details, Model Training, etc.)
How (Including sections of model usage information such as How to use, How to download, etc.)
Why (Including sections of model aims such as model Uses, Model Comparision, etc.)
When (Including sections of time-sensitive information such as Version News.)
Who (Including sections of member information such as License, Contributor, Acknowledgements, etc. )
Reference (Including sections of external information such as Reference, Citation, etc.)
Other (Including sections of other information about models such as Image, Disclaimer, etc.)
*
9.
What categories do you think should be included in a high-quality model card? (multiple choice OK)【多选题】
What (Including sections of model introduction such as Model Description, Model Details, Model Training, etc.)
How (Including sections of model usage information such as How to use, How to download, etc.)
Why (Including sections of model aims such as model Uses, Model Comparision, etc.)
When (Including sections of time-sensitive information such as Version News.)
Who (Including sections of member information such as License, Contributor, Acknowledgements, etc. )
Reference (Including sections of external information such as Reference, Citation, etc.)
Other (Including sections of other information about models such as Image, Disclaimer, etc.)
*
10.
According to your definition of the quality of model cards, would you prefer to use models that have high-quality Model Cards?
Yes
No
*
11.
What are the bad effects of low-quality model cards?
*
12.
What strategies do you think can be adopted to address low-quality model cards?
*
13.
What convenience will high-quality model cards bring to you?
14.
Please enter your email address if it is convenient.
问卷星提供技术支持
举报