good_bad_grey — scoring algo evaluation

Ranking-first evaluation of the product scoring algo against a blind multi-LLM judge panel. Experiments collapse by algo content ({prompt+config} hash), so re-runs, branches, and merges of the same algo appear once.

Experiments (2) — agreement vs baseline

Baseline ⭐ = 84001160e998 (branch main). Each cell is this experiment's ensemble Spearman with the delta vs baseline; green = closer to the judge panel, red = further. #inv = consensus rank inversions.

experiment	comedogenicity	irritation_risk	barrier_impact	photosensitivity_risk	sensitization	endocrine_chronic	hydration_barrier	oil_control	surface_renewal	anti_inflammatory	antimicrobial	antioxidant	brightening	firmness_collagen	#inv
b8e85befb448 exp/hero-active-benefit-bonus · f8ff93b8 · 1 run(s)	—	—	—	—	—	—	—	0.582 (+0.072)	—	—	—	0.779 (-0.009)	0.623 (-0.012)	0.478 (-0.034)	5 (-23)
84001160e998 ⭐ main · 2c2048cb · 3 run(s)	0.869	0.403	0.396	0.712	0.480	0.818	0.102	0.511	0.679	0.211	0.307	0.788	0.635	0.512	28

Trend — ensemble Spearman across experiments

Experiment details

84001160e998

2026-08-13T13:10:03.653643+00:00 · clean · branch main · code 2c2048cb · prompt 3c1cb0a2a9fbda8f · config d778abee4d239730

benchmark serums-v1 v1 · judges: gpt-5.6-sol(inci), deepseek-v4-pro(inci)

Ensemble ranking agreement

metric	spearman	ndcg@5	top5
comedogenicity	0.869	0.774	0.600
irritation_risk	0.403	0.874	0.800
barrier_impact	0.396	0.746	0.600
photosensitivity_risk	0.712	0.742	0.400
sensitization	0.480	0.831	0.600
endocrine_chronic	0.818	0.797	0.600
hydration_barrier	0.102	0.492	0.200
oil_control	0.511	0.867	0.400
surface_renewal	0.679	0.948	0.600
anti_inflammatory	0.211	0.667	0.400
antimicrobial	0.307	0.678	0.400
antioxidant	0.788	0.858	0.600
brightening	0.635	0.871	0.600
firmness_collagen	0.512	0.858	0.600

Consensus inversions

metric	product	algo rank	judge rank	direction
irritation_risk	24846625	13	6–7	algo under-ranks
irritation_risk	21751584	15	3–4	algo under-ranks
irritation_risk	13806304	6	19–20	algo over-ranks
irritation_risk	1272752	8	14–17	algo over-ranks
barrier_impact	1252974	18	5–6	algo under-ranks
barrier_impact	5003158	17	7–7	algo under-ranks
photosensitivity_risk	262939	14	3–6	algo under-ranks
sensitization	1068000	8	15–17	algo over-ranks
sensitization	1272752	15	4–6	algo under-ranks
hydration_barrier	262939	1	16–19	algo over-ranks
hydration_barrier	7010178	7	13–14	algo over-ranks
hydration_barrier	5003166	13	4–6	algo under-ranks
hydration_barrier	2752247	15	4–8	algo under-ranks
hydration_barrier	307026	18	1–3	algo under-ranks
oil_control	1272752	7	20–20	algo over-ranks
oil_control	1252974	16	7–7	algo under-ranks
surface_renewal	13806304	6	16–19	algo over-ranks
surface_renewal	1252974	14	4–5	algo under-ranks
anti_inflammatory	13806304	20	5–6	algo under-ranks
anti_inflammatory	1272752	5	14–20	algo over-ranks
antimicrobial	7010178	17	6–8	algo under-ranks
antimicrobial	1068000	4	16–20	algo over-ranks
antimicrobial	1252974	18	6–7	algo under-ranks
antimicrobial	5003158	16	1–2	algo under-ranks
brightening	5003153	8	13–19	algo over-ranks
brightening	5003158	16	7–7	algo under-ranks
firmness_collagen	5003166	16	1–4	algo under-ranks
firmness_collagen	757628	6	13–17	algo over-ranks

Full per-judge scorecard

metric	judge	spearman	kendall	ndcg5	top5	mean_drank	bucket_exact
comedogenicity	gpt-5.6-sol:inci	0.829	0.661	0.675	0.600	2.600	0.400
comedogenicity	deepseek-v4-pro:inci	0.860	0.715	0.815	0.800	2.350	0.400
comedogenicity	ensemble	0.869	0.696	0.774	0.600	2.500	0.350
irritation_risk	gpt-5.6-sol:inci	0.429	0.305	0.916	0.800	4.800	0.450
irritation_risk	deepseek-v4-pro:inci	0.378	0.240	0.805	0.600	5.150	0.350
irritation_risk	ensemble	0.403	0.286	0.874	0.800	4.850	0.450
barrier_impact	gpt-5.6-sol:inci	0.353	0.232	0.772	0.600	5.300	0.250
barrier_impact	deepseek-v4-pro:inci	0.542	0.381	0.712	0.600	4.000	0.450
barrier_impact	ensemble	0.396	0.274	0.746	0.600	4.900	0.350
photosensitivity_risk	gpt-5.6-sol:inci	0.696	0.532	0.610	0.400	3.750	0.350
photosensitivity_risk	deepseek-v4-pro:inci	0.699	0.537	0.743	0.400	3.650	0.500
photosensitivity_risk	ensemble	0.712	0.521	0.742	0.400	3.650	0.300
sensitization	gpt-5.6-sol:inci	0.543	0.370	0.888	0.600	4.500	0.350
sensitization	deepseek-v4-pro:inci	0.409	0.324	0.784	0.600	4.700	0.450
sensitization	ensemble	0.480	0.381	0.831	0.600	4.750	0.300
endocrine_chronic	gpt-5.6-sol:inci	0.732	0.521	0.789	0.400	3.450	0.300
endocrine_chronic	deepseek-v4-pro:inci	0.375	0.283	0.611	0.400	5.150	0.200
endocrine_chronic	ensemble	0.818	0.620	0.797	0.600	2.550	0.550
hydration_barrier	gpt-5.6-sol:inci	-0.003	0.026	0.377	0.000	6.850	0.150
hydration_barrier	deepseek-v4-pro:inci	0.157	0.140	0.563	0.200	5.750	0.350
hydration_barrier	ensemble	0.102	0.116	0.492	0.200	6.200	0.150
oil_control	gpt-5.6-sol:inci	0.537	0.379	0.877	0.600	4.600	0.250
oil_control	deepseek-v4-pro:inci	0.518	0.364	0.841	0.600	4.900	0.200
oil_control	ensemble	0.511	0.354	0.867	0.400	4.850	0.200
surface_renewal	gpt-5.6-sol:inci	0.631	0.461	0.910	0.600	3.650	0.450
surface_renewal	deepseek-v4-pro:inci	0.560	0.469	0.879	0.600	3.750	0.450
surface_renewal	ensemble	0.679	0.519	0.948	0.600	3.300	0.350
anti_inflammatory	gpt-5.6-sol:inci	-0.175	-0.138	0.418	0.400	6.800	0.250
anti_inflammatory	deepseek-v4-pro:inci	0.505	0.372	0.781	0.400	4.200	0.450
anti_inflammatory	ensemble	0.211	0.085	0.667	0.400	5.550	0.300
antimicrobial	gpt-5.6-sol:inci	0.283	0.185	0.653	0.200	5.250	0.400
antimicrobial	deepseek-v4-pro:inci	0.366	0.291	0.720	0.400	5.200	0.400
antimicrobial	ensemble	0.307	0.227	0.678	0.400	5.250	0.300
antioxidant	gpt-5.6-sol:inci	0.719	0.554	0.899	0.600	3.400	0.400
antioxidant	deepseek-v4-pro:inci	0.760	0.579	0.820	0.600	3.350	0.300
antioxidant	ensemble	0.788	0.596	0.858	0.600	2.900	0.400
brightening	gpt-5.6-sol:inci	0.630	0.442	0.923	0.400	4.000	0.500
brightening	deepseek-v4-pro:inci	0.493	0.337	0.805	0.600	4.600	0.350
brightening	ensemble	0.635	0.442	0.871	0.600	3.900	0.450
firmness_collagen	gpt-5.6-sol:inci	0.549	0.406	0.882	0.400	4.200	0.350
firmness_collagen	deepseek-v4-pro:inci	0.412	0.306	0.815	0.600	5.350	0.250
firmness_collagen	ensemble	0.512	0.375	0.858	0.600	4.700	0.200

b8e85befb448

2026-08-11T13:39:36.185850+00:00 · clean · branch exp/hero-active-benefit-bonus · code f8ff93b8 · prompt 3c1cb0a2a9fbda8f · config cd59287fb260afee

benchmark serums-v1 v1 · judges: gpt-5.6-sol(inci), deepseek-v4-pro(inci), gpt-5.4-pro(full)

Ensemble ranking agreement

metric	spearman	ndcg@5	top5
oil_control	0.582	0.862	0.600
antioxidant	0.779	0.867	0.600
brightening	0.623	0.868	0.600
firmness_collagen	0.478	0.833	0.600

Consensus inversions

metric	product	algo rank	judge rank	direction
oil_control	1272752	7	18–20	algo over-ranks
oil_control	1252974	15	7–7	algo under-ranks
brightening	5003153	7	13–19	algo over-ranks
brightening	5003158	15	5–7	algo under-ranks
firmness_collagen	5003166	16	1–4	algo under-ranks

Full per-judge scorecard

metric	judge	spearman	kendall	ndcg5	top5	mean_drank	bucket_exact
oil_control	gpt-5.6-sol:inci	0.593	0.410	0.877	0.600	4.300	0.250
oil_control	deepseek-v4-pro:inci	0.570	0.396	0.841	0.600	4.600	0.200
oil_control	gpt-5.4-pro:full	0.514	0.364	0.843	0.600	4.650	0.200
oil_control	ensemble	0.582	0.396	0.862	0.600	4.450	0.200
antioxidant	gpt-5.6-sol:inci	0.694	0.554	0.906	0.600	3.300	0.600
antioxidant	deepseek-v4-pro:inci	0.749	0.567	0.833	0.600	3.400	0.400
antioxidant	gpt-5.4-pro:full	0.668	0.508	0.857	0.600	3.600	0.600
antioxidant	ensemble	0.779	0.607	0.867	0.600	2.800	0.700
brightening	gpt-5.6-sol:inci	0.669	0.474	0.926	0.400	3.900	0.350
brightening	deepseek-v4-pro:inci	0.526	0.381	0.817	0.600	4.400	0.150
brightening	gpt-5.4-pro:full	0.541	0.347	0.831	0.400	4.600	0.250
brightening	ensemble	0.623	0.438	0.868	0.600	4.200	0.250
firmness_collagen	gpt-5.6-sol:inci	0.556	0.413	0.886	0.400	4.200	0.300
firmness_collagen	deepseek-v4-pro:inci	0.425	0.324	0.825	0.600	5.200	0.300
firmness_collagen	gpt-5.4-pro:full	0.423	0.311	0.760	0.600	4.800	0.250
firmness_collagen	ensemble	0.478	0.354	0.833	0.600	4.650	0.300

Generated by eval.portal. Source of truth: eval/results/.