Back to Skills
Ai-research

nemo-evaluator-sdk

Evaluates LLMs across 100+ benchmarks from 18+ harnesses (MMLU, HumanEval, GSM8K, safety, VLM) with multi-backend execution. Use when needing scalable evaluation on…

nemo-evaluator-sdk is an Agent Skill — a folder with a SKILL.md and any helper scripts that a coding agent loads on demand. Drop it in your skills directory and the agent picks it up the next time the task matches.

We keep this entry in sync on a schedule, so the counts and the description track the upstream project.

CategoryAi-research
/skill add nemo-evaluator-sdk

How to use it

  1. Copy the skill folder into your agent's skills directory, or run the add command above.
  2. Reload the agent so it re-scans available skills.
  3. Trigger it by describing the task — the agent loads the skill when it matches.
Compiled and written by HowToPrompts from public sources.

Related in Ai-research

agent-evaluationTesting and benchmarking LLM agents including behavioral testing, capability assessment, reliability metrics, agent-manager-skillManage multiple local CLI agents via tmux sessions (start/stop/monitor/assign) with cron-friendly scheduling.crewai-multi-agentMulti-agent orchestration framework for autonomous AI collaboration. Use when building teams of specialized agai-agents-architectExpert in designing and building autonomous AI agents. Masters tool use, memory systems, planning strategies, langchainFramework for building LLM-powered applications with agents, chains, and RAG. Supports multiple providers (Opeautonomous-agentsAutonomous agents are AI systems that can independently decompose goals, plan actions, execute tools, and selfagent-tool-builderTools are how AI agents interact with the world. A well-designed tool is the difference between an agent that conversation-memoryPersistent memory systems for LLM conversations including short-term, long-term, and entity-based memory Use wagent-memory-mcpA hybrid memory system that provides persistent, searchable knowledge management for AI agents (Architecture, autogpt-agentsAutonomous AI agent platform for building and deploying continuous agents. Use when creating visual workflow a
← Back to Skills