Skip to content
Intelligence Per Watt
mmlu_pro
Initializing search
HazyResearch/intelligence-per-watt
Intelligence Per Watt
HazyResearch/intelligence-per-watt
Home
Getting Started
Getting Started
Installation
Prerequisites
Quickstart
User Guide
User Guide
Single-Turn Profiling
Agentic Profiling
Analysis
Visualization
Export Formats
Agents
Agents
Overview
ReAct
OpenHands
Terminus
Datasets
Datasets
Overview
Single-Turn
Agentic
Coding
Telemetry
Telemetry
Energy Monitor
Platform Support
Traces
Metrics Reference
Cost
Cost
Pricing
Extending
Extending
Adding Clients
Adding Datasets
Adding Agents
Adding Collectors
API Reference
API Reference
ipw
ipw
Index
agents
agents
Index
base
mcp
mcp
Index
anthropic_server
base
gemini_server
ollama_server
openai_server
openrouter_server
retrieval
retrieval
Index
base
bm25_server
dense_server
grep_server
hybrid_server
index_manager
tool_registry
tool_server
vllm_server
openhands
react
terminus
analysis
analysis
Index
accuracy
base
helpers
regression
cli
cli
Index
analyze
list
plot
profile
run
clients
clients
Index
base
ollama
openai
openai_server
vllm
compute
compute
Index
flops
core
core
Index
registry
types
cost
cost
Index
pricing
datasets
datasets
Index
base
frames
gaia
hle
ipw
ipw
Index
ipw
mmlu_pro
mmlu_pro
Table of contents
mmlu_pro
simpleqa
supergpqa
swebench
swefficiency
terminalbench
evaluation
evaluation
Index
base
frames
gaia
gpqa
helpers
hle
math500
mcq
mmlu_pro
natural_reasoning
simpleqa
terminalbench
wildchat
execution
execution
Index
agentic_runner
exporters
hardware
runner
telemetry_session
trace
types
telemetry
telemetry
Index
collector
events
launcher
proto
tests
tests
Index
agents
agents
Index
mcp
mcp
Index
test_base_mcp
test_openai_server
test_tool_registry
test_tool_server
test_base
analysis
analysis
Index
test_accuracy
test_helpers
test_regression
cli
cli
Index
test_analyze
test_run
clients
clients
Index
test_base
test_clients_registration
test_ollama_client
test_vllm
compute
compute
Index
test_flops
conftest
core
core
Index
test_cost
test_dataset_provider
test_registry
test_trace
test_types
datasets
datasets
Index
test_frames
test_gaia
test_hle
test_ipw
test_mmlu_pro_dataset
test_simpleqa
test_supergpqa_dataset
test_swebench
test_swefficiency
evaluation
evaluation
Index
test_frames_eval
test_gaia_eval
test_hle_eval
test_simpleqa_eval
execution
execution
Index
test_agentic_runner
test_exporters
test_hardware
test_runner
test_telemetry_session
integration
integration
Index
test_amd_telemetry
test_apple_telemetry
test_e2e_pipeline
test_nvidia_telemetry
telemetry
telemetry
Index
test_energy_monitor
test_events
visualization
visualization
Index
test_regression
visualization
visualization
Index
base
output_kde
regression
Table of contents
mmlu_pro
mmlu_pro
ipw.datasets.mmlu_pro
¶
Back to top