good_bad_grey — scoring algo evaluation

Ranking-first evaluation of the product scoring algo against a blind multi-LLM judge panel. Experiments collapse by algo content ({prompt+config} hash), so re-runs, branches, and merges of the same algo appear once.

Experiments (4) — agreement vs baseline

Baseline ⭐ = 84001160e998 (branch main). Each cell is this experiment's ensemble Spearman with the delta vs baseline; green = closer to the judge panel, red = further. #inv = consensus rank inversions.

experimentcomedogenicityirritation_riskbarrier_impactphotosensitivity_risksensitizationendocrine_chronichydration_barrieroil_controlsurface_renewalanti_inflammatoryantimicrobialantioxidantbrighteningfirmness_collagen#inv
b8e85befb448
exp/hero-active-benefit-bonus · f8ff93b8 · 1 run(s)
0.582 (+0.072)0.779 (-0.009)0.623 (-0.012)0.478 (-0.034)5 (-23)
84001160e998
main · 2c2048cb · 3 run(s)
0.8690.4030.3960.7120.4800.8180.1020.5110.6790.2110.3070.7880.6350.51228
51a83e4a5cb0
exp/cumulative-diffuse-benefits · c67619b9 · 1 run(s)
0.869 (+0.000)0.403 (+0.000)0.396 (+0.000)0.712 (+0.000)0.480 (+0.000)0.818 (+0.000)-0.062 (-0.164)0.511 (+0.000)0.679 (+0.000)0.182 (-0.029)0.388 (+0.081)0.788 (+0.000)0.635 (+0.000)0.512 (+0.000)29 (+1)
d3ce18fae78d
exp/cumulative-flat-diffuse · 4b466142 · 1 run(s)
0.869 (+0.000)0.403 (+0.000)0.396 (+0.000)0.712 (+0.000)0.480 (+0.000)0.818 (+0.000)0.186 (+0.084)0.511 (+0.000)0.679 (+0.000)0.177 (-0.034)0.484 (+0.177)0.788 (+0.000)0.635 (+0.000)0.512 (+0.000)26 (-2)

Trend — ensemble Spearman across experiments

0.000.250.500.751.00b8e85befb44884001160e99851a83e4a5cb0d3ce18fae78dcomedogenicityirritation_riskbarrier_impactphotosensitivity_risksensitizationendocrine_chronichydration_barrieroil_controlsurface_renewalanti_inflammatoryantimicrobialantioxidantbrighteningfirmness_collagen

Experiment details

d3ce18fae78d

2026-08-13T16:14:44.617992+00:00 · clean · branch exp/cumulative-flat-diffuse · code 4b466142 · prompt 3c1cb0a2a9fbda8f · config c04343e765818f5f

benchmark serums-v1 v1 · judges: gpt-5.6-sol(inci), deepseek-v4-pro(inci)

Ensemble ranking agreement

metricspearmanndcg@5top5
comedogenicity0.8690.7740.600
irritation_risk0.4030.8740.800
barrier_impact0.3960.7460.600
photosensitivity_risk0.7120.7420.400
sensitization0.4800.8310.600
endocrine_chronic0.8180.7970.600
hydration_barrier0.1860.4950.400
oil_control0.5110.8670.400
surface_renewal0.6790.9480.600
anti_inflammatory0.1770.7640.600
antimicrobial0.4840.7570.600
antioxidant0.7880.8580.600
brightening0.6350.8710.600
firmness_collagen0.5120.8580.600

Consensus inversions

metricproductalgo rankjudge rankdirection
irritation_risk24846625136–7algo under-ranks
irritation_risk21751584153–4algo under-ranks
irritation_risk13806304619–20algo over-ranks
irritation_risk1272752814–17algo over-ranks
barrier_impact1252974185–6algo under-ranks
barrier_impact5003158177–7algo under-ranks
photosensitivity_risk262939143–6algo under-ranks
sensitization1068000815–17algo over-ranks
sensitization1272752154–6algo under-ranks
hydration_barrier262939116–19algo over-ranks
hydration_barrier5003166194–6algo under-ranks
hydration_barrier1068000314–14algo over-ranks
oil_control1272752720–20algo over-ranks
oil_control1252974167–7algo under-ranks
surface_renewal13806304616–19algo over-ranks
surface_renewal1252974144–5algo under-ranks
anti_inflammatory7010178816–16algo over-ranks
anti_inflammatory13806304195–6algo under-ranks
anti_inflammatory1272752714–20algo over-ranks
antimicrobial1068000616–20algo over-ranks
antimicrobial1252974156–7algo under-ranks
antimicrobial5003158161–2algo under-ranks
brightening5003153813–19algo over-ranks
brightening5003158167–7algo under-ranks
firmness_collagen5003166161–4algo under-ranks
firmness_collagen757628613–17algo over-ranks
Full per-judge scorecard
metricjudgespearmankendallndcg5top5mean_drankbucket_exact
comedogenicitygpt-5.6-sol:inci0.8290.6610.6750.6002.6000.400
comedogenicitydeepseek-v4-pro:inci0.8600.7150.8150.8002.3500.400
comedogenicityensemble0.8690.6960.7740.6002.5000.350
irritation_riskgpt-5.6-sol:inci0.4290.3050.9160.8004.8000.450
irritation_riskdeepseek-v4-pro:inci0.3780.2400.8050.6005.1500.350
irritation_riskensemble0.4030.2860.8740.8004.8500.450
barrier_impactgpt-5.6-sol:inci0.3530.2320.7720.6005.3000.250
barrier_impactdeepseek-v4-pro:inci0.5420.3810.7120.6004.0000.450
barrier_impactensemble0.3960.2740.7460.6004.9000.350
photosensitivity_riskgpt-5.6-sol:inci0.6960.5320.6100.4003.7500.350
photosensitivity_riskdeepseek-v4-pro:inci0.6990.5370.7430.4003.6500.500
photosensitivity_riskensemble0.7120.5210.7420.4003.6500.300
sensitizationgpt-5.6-sol:inci0.5430.3700.8880.6004.5000.350
sensitizationdeepseek-v4-pro:inci0.4090.3240.7840.6004.7000.450
sensitizationensemble0.4800.3810.8310.6004.7500.300
endocrine_chronicgpt-5.6-sol:inci0.7320.5210.7890.4003.4500.300
endocrine_chronicdeepseek-v4-pro:inci0.3750.2830.6110.4005.1500.200
endocrine_chronicensemble0.8180.6200.7970.6002.5500.550
hydration_barriergpt-5.6-sol:inci0.0170.0160.4170.4006.2000.200
hydration_barrierdeepseek-v4-pro:inci0.3170.2470.5370.4005.3500.250
hydration_barrierensemble0.1860.1470.4950.4005.7000.250
oil_controlgpt-5.6-sol:inci0.5370.3790.8770.6004.6000.250
oil_controldeepseek-v4-pro:inci0.5180.3640.8410.6004.9000.200
oil_controlensemble0.5110.3540.8670.4004.8500.200
surface_renewalgpt-5.6-sol:inci0.6310.4610.9100.6003.6500.450
surface_renewaldeepseek-v4-pro:inci0.5600.4690.8790.6003.7500.450
surface_renewalensemble0.6790.5190.9480.6003.3000.350
anti_inflammatorygpt-5.6-sol:inci-0.355-0.2590.4510.4007.7500.050
anti_inflammatorydeepseek-v4-pro:inci0.5280.3760.8850.6004.5000.300
anti_inflammatoryensemble0.1770.0790.7640.6006.2500.250
antimicrobialgpt-5.6-sol:inci0.4650.3330.8220.6004.5500.300
antimicrobialdeepseek-v4-pro:inci0.5290.3810.7000.6004.4000.350
antimicrobialensemble0.4840.3540.7570.6004.5000.400
antioxidantgpt-5.6-sol:inci0.7190.5540.8990.6003.4000.400
antioxidantdeepseek-v4-pro:inci0.7600.5790.8200.6003.3500.300
antioxidantensemble0.7880.5960.8580.6002.9000.400
brighteninggpt-5.6-sol:inci0.6300.4420.9230.4004.0000.500
brighteningdeepseek-v4-pro:inci0.4930.3370.8050.6004.6000.350
brighteningensemble0.6350.4420.8710.6003.9000.450
firmness_collagengpt-5.6-sol:inci0.5490.4060.8820.4004.2000.350
firmness_collagendeepseek-v4-pro:inci0.4120.3060.8150.6005.3500.250
firmness_collagenensemble0.5120.3750.8580.6004.7000.200

51a83e4a5cb0

2026-08-13T15:50:00.491662+00:00 · clean · branch exp/cumulative-diffuse-benefits · code c67619b9 · prompt 3c1cb0a2a9fbda8f · config 78efc5f04806d1a4

benchmark serums-v1 v1 · judges: gpt-5.6-sol(inci), deepseek-v4-pro(inci)

Ensemble ranking agreement

metricspearmanndcg@5top5
comedogenicity0.8690.7740.600
irritation_risk0.4030.8740.800
barrier_impact0.3960.7460.600
photosensitivity_risk0.7120.7420.400
sensitization0.4800.8310.600
endocrine_chronic0.8180.7970.600
hydration_barrier-0.0620.4920.200
oil_control0.5110.8670.400
surface_renewal0.6790.9480.600
anti_inflammatory0.1820.6290.400
antimicrobial0.3880.7130.600
antioxidant0.7880.8580.600
brightening0.6350.8710.600
firmness_collagen0.5120.8580.600

Consensus inversions

metricproductalgo rankjudge rankdirection
irritation_risk24846625136–7algo under-ranks
irritation_risk21751584153–4algo under-ranks
irritation_risk13806304619–20algo over-ranks
irritation_risk1272752814–17algo over-ranks
barrier_impact1252974185–6algo under-ranks
barrier_impact5003158177–7algo under-ranks
photosensitivity_risk262939143–6algo under-ranks
sensitization1068000815–17algo over-ranks
sensitization1272752154–6algo under-ranks
hydration_barrier262939116–19algo over-ranks
hydration_barrier5003166174–6algo under-ranks
hydration_barrier1272752151–8algo under-ranks
hydration_barrier1068005616–17algo over-ranks
hydration_barrier307026191–3algo under-ranks
oil_control1272752720–20algo over-ranks
oil_control1252974167–7algo under-ranks
surface_renewal13806304616–19algo over-ranks
surface_renewal1252974144–5algo under-ranks
anti_inflammatory13806304195–6algo under-ranks
anti_inflammatory1272752414–20algo over-ranks
antimicrobial7010178136–8algo under-ranks
antimicrobial5003166814–20algo over-ranks
antimicrobial1068000516–20algo over-ranks
antimicrobial5003158151–2algo under-ranks
antimicrobial307026146–8algo under-ranks
brightening5003153813–19algo over-ranks
brightening5003158167–7algo under-ranks
firmness_collagen5003166161–4algo under-ranks
firmness_collagen757628613–17algo over-ranks
Full per-judge scorecard
metricjudgespearmankendallndcg5top5mean_drankbucket_exact
comedogenicitygpt-5.6-sol:inci0.8290.6610.6750.6002.6000.400
comedogenicitydeepseek-v4-pro:inci0.8600.7150.8150.8002.3500.400
comedogenicityensemble0.8690.6960.7740.6002.5000.350
irritation_riskgpt-5.6-sol:inci0.4290.3050.9160.8004.8000.450
irritation_riskdeepseek-v4-pro:inci0.3780.2400.8050.6005.1500.350
irritation_riskensemble0.4030.2860.8740.8004.8500.450
barrier_impactgpt-5.6-sol:inci0.3530.2320.7720.6005.3000.250
barrier_impactdeepseek-v4-pro:inci0.5420.3810.7120.6004.0000.450
barrier_impactensemble0.3960.2740.7460.6004.9000.350
photosensitivity_riskgpt-5.6-sol:inci0.6960.5320.6100.4003.7500.350
photosensitivity_riskdeepseek-v4-pro:inci0.6990.5370.7430.4003.6500.500
photosensitivity_riskensemble0.7120.5210.7420.4003.6500.300
sensitizationgpt-5.6-sol:inci0.5430.3700.8880.6004.5000.350
sensitizationdeepseek-v4-pro:inci0.4090.3240.7840.6004.7000.450
sensitizationensemble0.4800.3810.8310.6004.7500.300
endocrine_chronicgpt-5.6-sol:inci0.7320.5210.7890.4003.4500.300
endocrine_chronicdeepseek-v4-pro:inci0.3750.2830.6110.4005.1500.200
endocrine_chronicensemble0.8180.6200.7970.6002.5500.550
hydration_barriergpt-5.6-sol:inci-0.263-0.1650.3710.0007.6000.150
hydration_barrierdeepseek-v4-pro:inci0.1200.1080.5670.2006.2000.150
hydration_barrierensemble-0.0620.0110.4920.2006.8000.200
oil_controlgpt-5.6-sol:inci0.5370.3790.8770.6004.6000.250
oil_controldeepseek-v4-pro:inci0.5180.3640.8410.6004.9000.200
oil_controlensemble0.5110.3540.8670.4004.8500.200
surface_renewalgpt-5.6-sol:inci0.6310.4610.9100.6003.6500.450
surface_renewaldeepseek-v4-pro:inci0.5600.4690.8790.6003.7500.450
surface_renewalensemble0.6790.5190.9480.6003.3000.350
anti_inflammatorygpt-5.6-sol:inci-0.118-0.0790.3880.4006.5000.100
anti_inflammatorydeepseek-v4-pro:inci0.4120.3010.7530.4005.0500.150
anti_inflammatoryensemble0.1820.1320.6290.4005.9500.200
antimicrobialgpt-5.6-sol:inci0.4560.3110.7510.6004.5500.300
antimicrobialdeepseek-v4-pro:inci0.4040.2800.6900.6004.9500.300
antimicrobialensemble0.3880.2900.7130.6004.9000.350
antioxidantgpt-5.6-sol:inci0.7190.5540.8990.6003.4000.400
antioxidantdeepseek-v4-pro:inci0.7600.5790.8200.6003.3500.300
antioxidantensemble0.7880.5960.8580.6002.9000.400
brighteninggpt-5.6-sol:inci0.6300.4420.9230.4004.0000.500
brighteningdeepseek-v4-pro:inci0.4930.3370.8050.6004.6000.350
brighteningensemble0.6350.4420.8710.6003.9000.450
firmness_collagengpt-5.6-sol:inci0.5490.4060.8820.4004.2000.350
firmness_collagendeepseek-v4-pro:inci0.4120.3060.8150.6005.3500.250
firmness_collagenensemble0.5120.3750.8580.6004.7000.200

84001160e998

2026-08-13T13:10:03.653643+00:00 · clean · branch main · code 2c2048cb · prompt 3c1cb0a2a9fbda8f · config d778abee4d239730

benchmark serums-v1 v1 · judges: gpt-5.6-sol(inci), deepseek-v4-pro(inci)

Ensemble ranking agreement

metricspearmanndcg@5top5
comedogenicity0.8690.7740.600
irritation_risk0.4030.8740.800
barrier_impact0.3960.7460.600
photosensitivity_risk0.7120.7420.400
sensitization0.4800.8310.600
endocrine_chronic0.8180.7970.600
hydration_barrier0.1020.4920.200
oil_control0.5110.8670.400
surface_renewal0.6790.9480.600
anti_inflammatory0.2110.6670.400
antimicrobial0.3070.6780.400
antioxidant0.7880.8580.600
brightening0.6350.8710.600
firmness_collagen0.5120.8580.600

Consensus inversions

metricproductalgo rankjudge rankdirection
irritation_risk24846625136–7algo under-ranks
irritation_risk21751584153–4algo under-ranks
irritation_risk13806304619–20algo over-ranks
irritation_risk1272752814–17algo over-ranks
barrier_impact1252974185–6algo under-ranks
barrier_impact5003158177–7algo under-ranks
photosensitivity_risk262939143–6algo under-ranks
sensitization1068000815–17algo over-ranks
sensitization1272752154–6algo under-ranks
hydration_barrier262939116–19algo over-ranks
hydration_barrier7010178713–14algo over-ranks
hydration_barrier5003166134–6algo under-ranks
hydration_barrier2752247154–8algo under-ranks
hydration_barrier307026181–3algo under-ranks
oil_control1272752720–20algo over-ranks
oil_control1252974167–7algo under-ranks
surface_renewal13806304616–19algo over-ranks
surface_renewal1252974144–5algo under-ranks
anti_inflammatory13806304205–6algo under-ranks
anti_inflammatory1272752514–20algo over-ranks
antimicrobial7010178176–8algo under-ranks
antimicrobial1068000416–20algo over-ranks
antimicrobial1252974186–7algo under-ranks
antimicrobial5003158161–2algo under-ranks
brightening5003153813–19algo over-ranks
brightening5003158167–7algo under-ranks
firmness_collagen5003166161–4algo under-ranks
firmness_collagen757628613–17algo over-ranks
Full per-judge scorecard
metricjudgespearmankendallndcg5top5mean_drankbucket_exact
comedogenicitygpt-5.6-sol:inci0.8290.6610.6750.6002.6000.400
comedogenicitydeepseek-v4-pro:inci0.8600.7150.8150.8002.3500.400
comedogenicityensemble0.8690.6960.7740.6002.5000.350
irritation_riskgpt-5.6-sol:inci0.4290.3050.9160.8004.8000.450
irritation_riskdeepseek-v4-pro:inci0.3780.2400.8050.6005.1500.350
irritation_riskensemble0.4030.2860.8740.8004.8500.450
barrier_impactgpt-5.6-sol:inci0.3530.2320.7720.6005.3000.250
barrier_impactdeepseek-v4-pro:inci0.5420.3810.7120.6004.0000.450
barrier_impactensemble0.3960.2740.7460.6004.9000.350
photosensitivity_riskgpt-5.6-sol:inci0.6960.5320.6100.4003.7500.350
photosensitivity_riskdeepseek-v4-pro:inci0.6990.5370.7430.4003.6500.500
photosensitivity_riskensemble0.7120.5210.7420.4003.6500.300
sensitizationgpt-5.6-sol:inci0.5430.3700.8880.6004.5000.350
sensitizationdeepseek-v4-pro:inci0.4090.3240.7840.6004.7000.450
sensitizationensemble0.4800.3810.8310.6004.7500.300
endocrine_chronicgpt-5.6-sol:inci0.7320.5210.7890.4003.4500.300
endocrine_chronicdeepseek-v4-pro:inci0.3750.2830.6110.4005.1500.200
endocrine_chronicensemble0.8180.6200.7970.6002.5500.550
hydration_barriergpt-5.6-sol:inci-0.0030.0260.3770.0006.8500.150
hydration_barrierdeepseek-v4-pro:inci0.1570.1400.5630.2005.7500.350
hydration_barrierensemble0.1020.1160.4920.2006.2000.150
oil_controlgpt-5.6-sol:inci0.5370.3790.8770.6004.6000.250
oil_controldeepseek-v4-pro:inci0.5180.3640.8410.6004.9000.200
oil_controlensemble0.5110.3540.8670.4004.8500.200
surface_renewalgpt-5.6-sol:inci0.6310.4610.9100.6003.6500.450
surface_renewaldeepseek-v4-pro:inci0.5600.4690.8790.6003.7500.450
surface_renewalensemble0.6790.5190.9480.6003.3000.350
anti_inflammatorygpt-5.6-sol:inci-0.175-0.1380.4180.4006.8000.250
anti_inflammatorydeepseek-v4-pro:inci0.5050.3720.7810.4004.2000.450
anti_inflammatoryensemble0.2110.0850.6670.4005.5500.300
antimicrobialgpt-5.6-sol:inci0.2830.1850.6530.2005.2500.400
antimicrobialdeepseek-v4-pro:inci0.3660.2910.7200.4005.2000.400
antimicrobialensemble0.3070.2270.6780.4005.2500.300
antioxidantgpt-5.6-sol:inci0.7190.5540.8990.6003.4000.400
antioxidantdeepseek-v4-pro:inci0.7600.5790.8200.6003.3500.300
antioxidantensemble0.7880.5960.8580.6002.9000.400
brighteninggpt-5.6-sol:inci0.6300.4420.9230.4004.0000.500
brighteningdeepseek-v4-pro:inci0.4930.3370.8050.6004.6000.350
brighteningensemble0.6350.4420.8710.6003.9000.450
firmness_collagengpt-5.6-sol:inci0.5490.4060.8820.4004.2000.350
firmness_collagendeepseek-v4-pro:inci0.4120.3060.8150.6005.3500.250
firmness_collagenensemble0.5120.3750.8580.6004.7000.200

b8e85befb448

2026-08-11T13:39:36.185850+00:00 · clean · branch exp/hero-active-benefit-bonus · code f8ff93b8 · prompt 3c1cb0a2a9fbda8f · config cd59287fb260afee

benchmark serums-v1 v1 · judges: gpt-5.6-sol(inci), deepseek-v4-pro(inci), gpt-5.4-pro(full)

Ensemble ranking agreement

metricspearmanndcg@5top5
oil_control0.5820.8620.600
antioxidant0.7790.8670.600
brightening0.6230.8680.600
firmness_collagen0.4780.8330.600

Consensus inversions

metricproductalgo rankjudge rankdirection
oil_control1272752718–20algo over-ranks
oil_control1252974157–7algo under-ranks
brightening5003153713–19algo over-ranks
brightening5003158155–7algo under-ranks
firmness_collagen5003166161–4algo under-ranks
Full per-judge scorecard
metricjudgespearmankendallndcg5top5mean_drankbucket_exact
oil_controlgpt-5.6-sol:inci0.5930.4100.8770.6004.3000.250
oil_controldeepseek-v4-pro:inci0.5700.3960.8410.6004.6000.200
oil_controlgpt-5.4-pro:full0.5140.3640.8430.6004.6500.200
oil_controlensemble0.5820.3960.8620.6004.4500.200
antioxidantgpt-5.6-sol:inci0.6940.5540.9060.6003.3000.600
antioxidantdeepseek-v4-pro:inci0.7490.5670.8330.6003.4000.400
antioxidantgpt-5.4-pro:full0.6680.5080.8570.6003.6000.600
antioxidantensemble0.7790.6070.8670.6002.8000.700
brighteninggpt-5.6-sol:inci0.6690.4740.9260.4003.9000.350
brighteningdeepseek-v4-pro:inci0.5260.3810.8170.6004.4000.150
brighteninggpt-5.4-pro:full0.5410.3470.8310.4004.6000.250
brighteningensemble0.6230.4380.8680.6004.2000.250
firmness_collagengpt-5.6-sol:inci0.5560.4130.8860.4004.2000.300
firmness_collagendeepseek-v4-pro:inci0.4250.3240.8250.6005.2000.300
firmness_collagengpt-5.4-pro:full0.4230.3110.7600.6004.8000.250
firmness_collagenensemble0.4780.3540.8330.6004.6500.300

Generated by eval.portal. Source of truth: eval/results/.