Running trustworthy online controlled experiments: the experiment as a decision with a hypothesis and a success metric, statistical power and minimum detectable effect before launch, randomisation units and stable bucketing, ramping percentages and the peeking problem, guardrail metrics that stop an experiment early, novelty and primacy effects that fade, multiple comparisons across a fleet, and the written experiment record. It explains how to design, run, and read a controlled experiment; it never certifies that a variant won. Use when asking "A/B test", "controlled experiment", "treatment arm", "randomisation unit", "minimum detectable effect", "statistical power", "peeking", "sequential testing", "novelty effect", "guardrail metric", "experiment ramp", "hash bucketing", "why did our A/B test flip sign". Not for trading strategy backtests (ac-backtest-integrity), not for prompt and model evaluation sets (ac-prompt-engineer), not for feature deployment mechanics like canary and rollback (ac-ci-and-release).
cp -r cryptoskill/skills/exchanges/anoscranel-ac-online-experiments .claude/skills/clawhub install anoscranel-ac-online-experimentsCapabilities below are detected automatically by an open-source scanner that reads the skill's text and scripts (see how this is computed). Not measured means the scanner couldn't make a confident call — it is NOT a green check, and you should treat it as a possible red flag until a human or a stronger scanner has measured it.
read_only Phase 1 single-mode classification — multi-mode breakdown deferred to Phase 2.
We did not find any well-known hosted services in this skill's text or scripts. This does NOT mean the skill is local-only — it might use services we don't yet recognize, or talk to them through code paths our scanner can't reach. A complete dependency list (every package, library, and binary, with integrity hashes) is on the roadmap; today we only show recognized hosts.
No one has audited this skill yet. That is different from “audited and clean” — it just means no professional reviewer (a security firm, the CryptoSkill team, or a verified independent researcher) has signed off on it. There are no audit reports to read. How reviewer levels work →
SKILL.md → SOURCE.md → TRUST.auto.yaml → Browse directory →
Auto-generated by cryptoskill/extract-capabilities/0.3.1 · hosted-service list version 2026-09-06 · how this is computed