手机扫描二维码答题
00:00:00
Usage Experience with large language models
录音中...
Please contribute your real conversations with LLMs, providing questions that you expect the conversational service to answer effectively, and help us build a diverse, high-quality, and user-centric LLM evaluation benchmark.
Your dialog reported in this questionnaire may be publicly released for research purposes, so please avoid including personal information, and we will also conduct a secondary check, thank you!
*
1.
Large language models you have used (Please rank by usage frequency)
【排序题】
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
*
2.
How often do you use LLMs
Daily
Weekly
Monthly
Tried a few times
Never
*
3.
Which of the following large language models did you ask the question to (1)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
4.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
5.
Your intent behind this question is
Factual QA
Fast and direct access to factual information
Solve Professional Problem
Seek answers or explanations in the field of programming, natural sciences, humanities, social sciences, etc. Address and learn about the profession
Text Assistant
summarize, polish, complete, translate text, etc.
Seek Creativity
Brainstorming for inspiration, innovative ideas, etc.
Ask for Advice
Career development, personal counseling, gift recommendation, etc., or creating personal schedules, travel plans, shopping lists, etc.
Leisure
Movie and music recommendations, games, and other entertaining activities
Others
*
*
6.
How difficult do you think the problem is
Easy
Medium
Hard
*
7.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
8.
Which of the following large language models did you ask the question to (2)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
9.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
10.
Your intent behind this question is
Factual Question Answering
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
11.
How difficult do you think the problem is
Easy
Medium
Hard
*
12.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
13.
Which of the following large language models did you ask the question to (3)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
14.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
15.
Your intent behind this question is
Factual QA
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
16.
How difficult do you think the problem is
Easy
Medium
Hard
*
17.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
18.
Which of the following large language models did you ask the question to (4)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
19.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
20.
Your intent behind this question is
Factual QA
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
21.
How difficult do you think the problem is
Easy
Medium
Hard
*
22.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
23.
Which of the following large language models did you ask the question to (5)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
24.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
25.
Your intent behind this question is
Factual QA
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
26.
How difficult do you think the problem is
Easy
Medium
Hard
*
27.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
28.
Do you want to contribute extra conversations?
Yes, I want to contribute more
No, thanks
*
29.
Which of the following large language models did you ask the question to (6)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
30.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
31.
Your intent behind this question is
Factual QA
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
32.
How difficult do you think the problem is
Easy
Medium
Hard
*
33.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
34.
Do you want to contribute extra conversations?
Yes, I want to contribute more
No, thanks
*
35.
Which of the following large language models did you ask the question to (7)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
36.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
37.
Your intent behind this question is
Factual QA
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
38.
How difficult do you think the problem is
Easy
Medium
Hard
*
39.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
40.
Do you want to contribute extra conversations?
Yes, I want to contribute more
No, thanks
*
41.
Which of the following large language models did you ask the question to (8)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
42.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
43.
Your intent behind this question is
Factual QA
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
44.
How difficult do you think the problem is
Easy
Medium
Hard
*
45.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
46.
Do you want to contribute extra conversations?
Yes, I want to contribute more
No, thanks
*
47.
Which of the following large language models did you ask the question to (9)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
48.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
49.
Your intent behind this question is
Factual QA
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
50.
How difficult do you think the problem is
Easy
Medium
Hard
*
51.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
52.
Do you want to contribute extra conversations?
Yes, I want to contribute more
No, thanks
*
53.
Which of the following large language models did you ask the question to (10)
请选择
Baichuan
Bard
Character.AI
ChatGLM
ChatGPT
Claude
DeepSeek
ERNIE Bot
Gemini
Kimi Chat
Llama
Mistral
New Bing
Qwen
Others
*
54.
Your question and the system's output
It is recommended to directly share your conversation link!
If you fill it out manually, please respectfully follow the format below.
Question: xxx
Answer: xxx
*
55.
Your intent behind this question is
Factual QA
Solve Professional Problem
Text Assistant
Seek Creativity
Ask for Advice
Leisure
Others
*
*
56.
How difficult do you think the problem is
Easy
Medium
Hard
*
57.
Your satisfaction with the system output
very dissatisfied
dissatisfied
neutral
satisfied
very satisfied
*
58.
Your age group
Under 12
12-17
18-21
22-25
26~30
31~40
41~50
51~60
60-70
Over 70
Do not wish to report
*
59.
your profession
Marketing/Sales/Commercial
Purchasing
Administration
Human Resource
Product/Operation Staff
Self-employed
Finance/Accounting/Cashier/Audit
Corporate Administrator
Lawyer/Legal
Designer
Service Worker
Technology Developer/Engineer
Agriculture, forestry and fishery laborers
Laborer
Full-time housewife/husband
Freelance
Retired/Retired
Elementary School Student
High School Student
Undergraduate
Graduate student
Teachers
Medical personnel
Researchers
Party and government organizations
Others
*
Do not wish to report
60.
What suggestions do you have for this questionnaire, or existing large language modeling evaluation benchmarks?
评价对象得分
字体大小
