good_bad_grey — scoring algo evaluation

Ranking-first evaluation of the product scoring algo against a blind multi-LLM judge panel. Experiments collapse by algo content ({prompt+config} hash), so re-runs, branches, and merges of the same algo appear once.

Experiments (2) — agreement vs baseline

Baseline ⭐ = 84001160e998 (branch main). Each cell is this experiment's ensemble Spearman with the delta vs baseline; green = closer to the judge panel, red = further. #inv = consensus rank inversions.

experimentcomedogenicityirritation_riskbarrier_impactphotosensitivity_risksensitizationendocrine_chronichydration_barrieroil_controlsurface_renewalanti_inflammatoryantimicrobialantioxidantbrighteningfirmness_collagen#inv
b8e85befb448
exp/hero-active-benefit-bonus · f8ff93b8 · 1 run(s)
0.582 (+0.072)0.779 (-0.009)0.623 (-0.012)0.478 (-0.034)5 (-23)
84001160e998
main · 2c2048cb · 3 run(s)
0.8690.4030.3960.7120.4800.8180.1020.5110.6790.2110.3070.7880.6350.51228

Trend — ensemble Spearman across experiments

0.000.250.500.751.00b8e85befb44884001160e998comedogenicityirritation_riskbarrier_impactphotosensitivity_risksensitizationendocrine_chronichydration_barrieroil_controlsurface_renewalanti_inflammatoryantimicrobialantioxidantbrighteningfirmness_collagen

Experiment details

84001160e998

2026-08-13T13:10:03.653643+00:00 · clean · branch main · code 2c2048cb · prompt 3c1cb0a2a9fbda8f · config d778abee4d239730

benchmark serums-v1 v1 · judges: gpt-5.6-sol(inci), deepseek-v4-pro(inci)

Ensemble ranking agreement

metricspearmanndcg@5top5
comedogenicity0.8690.7740.600
irritation_risk0.4030.8740.800
barrier_impact0.3960.7460.600
photosensitivity_risk0.7120.7420.400
sensitization0.4800.8310.600
endocrine_chronic0.8180.7970.600
hydration_barrier0.1020.4920.200
oil_control0.5110.8670.400
surface_renewal0.6790.9480.600
anti_inflammatory0.2110.6670.400
antimicrobial0.3070.6780.400
antioxidant0.7880.8580.600
brightening0.6350.8710.600
firmness_collagen0.5120.8580.600

Consensus inversions

metricproductalgo rankjudge rankdirection
irritation_risk24846625136–7algo under-ranks
irritation_risk21751584153–4algo under-ranks
irritation_risk13806304619–20algo over-ranks
irritation_risk1272752814–17algo over-ranks
barrier_impact1252974185–6algo under-ranks
barrier_impact5003158177–7algo under-ranks
photosensitivity_risk262939143–6algo under-ranks
sensitization1068000815–17algo over-ranks
sensitization1272752154–6algo under-ranks
hydration_barrier262939116–19algo over-ranks
hydration_barrier7010178713–14algo over-ranks
hydration_barrier5003166134–6algo under-ranks
hydration_barrier2752247154–8algo under-ranks
hydration_barrier307026181–3algo under-ranks
oil_control1272752720–20algo over-ranks
oil_control1252974167–7algo under-ranks
surface_renewal13806304616–19algo over-ranks
surface_renewal1252974144–5algo under-ranks
anti_inflammatory13806304205–6algo under-ranks
anti_inflammatory1272752514–20algo over-ranks
antimicrobial7010178176–8algo under-ranks
antimicrobial1068000416–20algo over-ranks
antimicrobial1252974186–7algo under-ranks
antimicrobial5003158161–2algo under-ranks
brightening5003153813–19algo over-ranks
brightening5003158167–7algo under-ranks
firmness_collagen5003166161–4algo under-ranks
firmness_collagen757628613–17algo over-ranks
Full per-judge scorecard
metricjudgespearmankendallndcg5top5mean_drankbucket_exact
comedogenicitygpt-5.6-sol:inci0.8290.6610.6750.6002.6000.400
comedogenicitydeepseek-v4-pro:inci0.8600.7150.8150.8002.3500.400
comedogenicityensemble0.8690.6960.7740.6002.5000.350
irritation_riskgpt-5.6-sol:inci0.4290.3050.9160.8004.8000.450
irritation_riskdeepseek-v4-pro:inci0.3780.2400.8050.6005.1500.350
irritation_riskensemble0.4030.2860.8740.8004.8500.450
barrier_impactgpt-5.6-sol:inci0.3530.2320.7720.6005.3000.250
barrier_impactdeepseek-v4-pro:inci0.5420.3810.7120.6004.0000.450
barrier_impactensemble0.3960.2740.7460.6004.9000.350
photosensitivity_riskgpt-5.6-sol:inci0.6960.5320.6100.4003.7500.350
photosensitivity_riskdeepseek-v4-pro:inci0.6990.5370.7430.4003.6500.500
photosensitivity_riskensemble0.7120.5210.7420.4003.6500.300
sensitizationgpt-5.6-sol:inci0.5430.3700.8880.6004.5000.350
sensitizationdeepseek-v4-pro:inci0.4090.3240.7840.6004.7000.450
sensitizationensemble0.4800.3810.8310.6004.7500.300
endocrine_chronicgpt-5.6-sol:inci0.7320.5210.7890.4003.4500.300
endocrine_chronicdeepseek-v4-pro:inci0.3750.2830.6110.4005.1500.200
endocrine_chronicensemble0.8180.6200.7970.6002.5500.550
hydration_barriergpt-5.6-sol:inci-0.0030.0260.3770.0006.8500.150
hydration_barrierdeepseek-v4-pro:inci0.1570.1400.5630.2005.7500.350
hydration_barrierensemble0.1020.1160.4920.2006.2000.150
oil_controlgpt-5.6-sol:inci0.5370.3790.8770.6004.6000.250
oil_controldeepseek-v4-pro:inci0.5180.3640.8410.6004.9000.200
oil_controlensemble0.5110.3540.8670.4004.8500.200
surface_renewalgpt-5.6-sol:inci0.6310.4610.9100.6003.6500.450
surface_renewaldeepseek-v4-pro:inci0.5600.4690.8790.6003.7500.450
surface_renewalensemble0.6790.5190.9480.6003.3000.350
anti_inflammatorygpt-5.6-sol:inci-0.175-0.1380.4180.4006.8000.250
anti_inflammatorydeepseek-v4-pro:inci0.5050.3720.7810.4004.2000.450
anti_inflammatoryensemble0.2110.0850.6670.4005.5500.300
antimicrobialgpt-5.6-sol:inci0.2830.1850.6530.2005.2500.400
antimicrobialdeepseek-v4-pro:inci0.3660.2910.7200.4005.2000.400
antimicrobialensemble0.3070.2270.6780.4005.2500.300
antioxidantgpt-5.6-sol:inci0.7190.5540.8990.6003.4000.400
antioxidantdeepseek-v4-pro:inci0.7600.5790.8200.6003.3500.300
antioxidantensemble0.7880.5960.8580.6002.9000.400
brighteninggpt-5.6-sol:inci0.6300.4420.9230.4004.0000.500
brighteningdeepseek-v4-pro:inci0.4930.3370.8050.6004.6000.350
brighteningensemble0.6350.4420.8710.6003.9000.450
firmness_collagengpt-5.6-sol:inci0.5490.4060.8820.4004.2000.350
firmness_collagendeepseek-v4-pro:inci0.4120.3060.8150.6005.3500.250
firmness_collagenensemble0.5120.3750.8580.6004.7000.200

b8e85befb448

2026-08-11T13:39:36.185850+00:00 · clean · branch exp/hero-active-benefit-bonus · code f8ff93b8 · prompt 3c1cb0a2a9fbda8f · config cd59287fb260afee

benchmark serums-v1 v1 · judges: gpt-5.6-sol(inci), deepseek-v4-pro(inci), gpt-5.4-pro(full)

Ensemble ranking agreement

metricspearmanndcg@5top5
oil_control0.5820.8620.600
antioxidant0.7790.8670.600
brightening0.6230.8680.600
firmness_collagen0.4780.8330.600

Consensus inversions

metricproductalgo rankjudge rankdirection
oil_control1272752718–20algo over-ranks
oil_control1252974157–7algo under-ranks
brightening5003153713–19algo over-ranks
brightening5003158155–7algo under-ranks
firmness_collagen5003166161–4algo under-ranks
Full per-judge scorecard
metricjudgespearmankendallndcg5top5mean_drankbucket_exact
oil_controlgpt-5.6-sol:inci0.5930.4100.8770.6004.3000.250
oil_controldeepseek-v4-pro:inci0.5700.3960.8410.6004.6000.200
oil_controlgpt-5.4-pro:full0.5140.3640.8430.6004.6500.200
oil_controlensemble0.5820.3960.8620.6004.4500.200
antioxidantgpt-5.6-sol:inci0.6940.5540.9060.6003.3000.600
antioxidantdeepseek-v4-pro:inci0.7490.5670.8330.6003.4000.400
antioxidantgpt-5.4-pro:full0.6680.5080.8570.6003.6000.600
antioxidantensemble0.7790.6070.8670.6002.8000.700
brighteninggpt-5.6-sol:inci0.6690.4740.9260.4003.9000.350
brighteningdeepseek-v4-pro:inci0.5260.3810.8170.6004.4000.150
brighteninggpt-5.4-pro:full0.5410.3470.8310.4004.6000.250
brighteningensemble0.6230.4380.8680.6004.2000.250
firmness_collagengpt-5.6-sol:inci0.5560.4130.8860.4004.2000.300
firmness_collagendeepseek-v4-pro:inci0.4250.3240.8250.6005.2000.300
firmness_collagengpt-5.4-pro:full0.4230.3110.7600.6004.8000.250
firmness_collagenensemble0.4780.3540.8330.6004.6500.300

Generated by eval.portal. Source of truth: eval/results/.