LLMEval3 vs 虾345：怎么选？
下面把两款工具的关键信息逐项放在一起对照。 两者同属「AI 聊天」分类，属于直接竞品。
📊 参数逐项对照
| 对比项 | LLMEval3 | 虾345 |
|---|---|---|
| 价格模式 | 免费 | 免费 |
| 来源地区 | 🌍 国外 | 🇨🇳 国内 |
| 所属分类 | AI 聊天 | AI 聊天 |
| 用户评分 | 暂无评分 | ⭐ 5.0 |
| 热度（浏览量） | 48 | 103 |
| 付费说明 | — | — |
| 替代品 | LLMEval3 的替代品 → | 虾345 的替代品 → |
📖 详细介绍
LLMEval3 是什么？
关于 LLMEval3
LLMEval-Logic is a Chinese logical reasoning benchmark built through a three-stage audit pipeline: (a) annotators authored items forward from real-world stories rather than templating backward from formulas, (b) a hand-written rubric checklist together with the Z3 SMT solver double-audited every natural-language → first-order-logic translation, and (c) a closed-loop adversarial hardening agent workflow discarded items that turned out to be too easy. The dataset has two paired splits — LLMEval-Logic-Base (single-question PL & FOL items with Z3-verified answers, gold formalisations and atom-level NL→FL rubrics) and LLMEval-Logic-Hard (multi-question / sub-question items covering enumeration / counting / uniqueness / alternative-solution / counterfactual reasoning). Three independent runs of 14 frontier LLMs under thinking / no-thinking configurations show the strongest model reaches only 37.5% Item Accuracy on Hard, leaving substantial headroom for frontier reasoning research. Following the contamination-resistant tradition of LLMEval-Fair, only 80% of the corpus is released publicly; the remaining 20% is held out as a private contamination-resistant test set maintained by Fudan NLP Lab.
LLMEval-Fair addresses robustness and fairness concerns in LLM evaluation through a 30-month longitudinal study. Built on a proprietary bank of 220,000 graduate-level questions across 13 academic disciplines, it dynamically samples unseen test sets for each evaluation run. Its automated pipeline ensures integrity via contamination-resistant data curation, a novel anti-cheating architecture, and a calibrated LLM-as-a-judge process achieving 90% agreement with human experts. A study of nearly 60 leading models reveals performance ceilings and exposes data contamination vulnerabilities undetectable by static benchmarks.
LLMEval-Med is a physician-validated benchmark for evaluating LLMs on real-world clinical tasks. It covers five core medical areas (Medical Knowledge, Language Understanding, Reasoning, Ethics & Safety, Text Generation) with 2,996 questions from real electronic health records and expert-designed clinical scenarios. An automated evaluation pipeline with expert-developed checklists is validated through human-machine agreement analysis. 13 LLMs across specialized, open-source, and closed-source categories are evaluated.
虾345 是什么？
关于 虾345
xia345（虾345）是全球最完整的 AI Agent 生态导航平台，也是养虾人的第一站。收录 OpenClaw 等 20+ Agent 客户端、PinchBench LLM 评测排行、7000+ 技能资产，以及全球养虾社区地图。
基于 PinchBench（OpenClaw 工具调用基准）评测排行，S 级：Claude 3.7 Sonnet、GPT-4o；A 级：Gemini 1.5 Pro、DeepSeek-V3；B 级：Qwen2.5、Kimi。