AI evals are becoming the new compute bottleneck
• 28
AI & ML interests
We’re building a research coalition on evaluating evaluations (EvalEval)! Hosted by Hugging Face, University of Edinburgh, and EleutherAI.
Recent Activity
View all activity
Articles
j-chim
updated a
Space about 7 hours ago
EvalEvalBot
published a
bucket about 8 hours ago
j-chim
updated a
bucket about 11 hours ago
evijit
updated a
dataset about 13 hours ago
evijit
updated a
bucket about 19 hours ago
evijit
updated a
Space about 19 hours ago
Post
165
Weekend mini project! Since commentary on AI is inherently interdisciplinary, we connected the observations in the Pope's encyclical with decades of scholarship in Responsible AI and Ethics research and created an interactive space with these annotations!
Work with @IJ-Reynolds , @yjernite , and @meg
Lots to unpack. We started with 105 annotations. Please submit pull requests for more that we may have missed!
society-ethics/annotated-encyclical
Work with @IJ-Reynolds , @yjernite , and @meg
Lots to unpack. We started with 105 annotations. Please submit pull requests for more that we may have missed!
society-ethics/annotated-encyclical
borgr
updated a
dataset 4 days ago
alielfilali01
posted an update 4 days ago
Post
203
Plans in HTML > Plans in Markdown
j-chim
updated a
dataset 5 days ago
j-chim
updated a
Space 5 days ago
[Submission] Add Vectara Hallucination Leaderboard results
1
#144 opened 6 days ago
by 
mokarami
Asaf-Yehudai
submitted a
paper to Daily Papers 6 days ago
[Submission] TAB Error Recovery - 9 models, third-party evaluation
1
#140 opened 9 days ago
by 
RodTAB
Add ResearchGym rg-agent GPT-5 results
5
#130 opened about 1 month ago
by 
anikethh
[ACL Shared Task] Add AlpacaEval
7
#129 opened about 1 month ago
by 
muhammadravi251001
EvalEvalBot
updated a
dataset 13 days ago
[Submission] Journalistic-Bias Revised
1
#135 opened 29 days ago
by 
WanderingIsle
[Submission] Journalistic-Bias
7
#122 opened about 1 month ago
by WanderingIsle
[ACL Shared Task] wmt25_bhojpuri_maasai: Low-resource MT evaluation (Bhojpuri & Maasai)
3
#133 opened about 1 month ago
by 
jboat