AI Blending, shared and compared.
Blend multiple models, outperform single models, share your orchestra.
pip install beethovainBrowse AI Blending, shared and compared.
Blend multiple models, outperform single models, share your orchestra.
judge (routing)
Blending: exaone-1.2b-ft. 1971 test cases. Duration: 33795379ms
exaone-1.2b-ftbenefit_classification
@beethovain0040d
17.14631112255405ms1 models
judge (routing)
Blending: exaone-1.2b. 1971 test cases. Duration: 10247787ms
exaone-1.2bbenefit_classification
@beethovain0040d
5.1992833161688985ms
judge (routing)
Blending: gemma-1b-ft. 1971 test cases. Duration: 9398232ms
gemma-1b-ftbenefit_classification
@beethovain0040d
4.768255767250256ms
judge (routing)
Blending: gemma-1b. 1971 test cases. Duration: 10786584ms
gemma-1bbenefit_classification
@beethovain0040d
5.472645571575693ms
extract (cascade)
Blending: exaone-7.8b + llama3kr-8b. 100 test cases. Duration: 12700000ms
exaone-7.8bllama3kr-8bbenefit_classification
@beethovain0040d
127ms
extract (solo)
Blending: gemma-4b. 100 test cases. Duration: 2990000ms
gemma-4bbenefit_classification
@beethovain0040d
29.9ms
extract (solo)
Blending: phi4-mini. 100 test cases. Duration: 1630000ms
phi4-minibenefit_classification
@beethovain0040d
16.3ms
self_correct (cascade)
Blending: exaone-1.2b. 100 test cases. Duration: 1240000ms
exaone-1.2bbenefit_classification
@beethovain0040d
12.4ms
extract (solo)
Blending: exaone-1.2b. 100 test cases. Duration: 740000ms
exaone-1.2bbenefit_classification
@beethovain0040d
7.4ms
judge (routing)
Blending: phi4-mini + llama3kr-8b. 21 test cases. Duration: 144900ms
phi4-minillama3kr-8bbenefit_classification
@beethovain0040d
6.9ms
judge (routing)
Blending: phi4-mini + exaone-7.8b. 21 test cases. Duration: 115500ms
phi4-miniexaone-7.8bbenefit_classification
@beethovain0040d
5.5ms
judge (ensemble)
Blending: phi4-mini + exaone-1.2b. 21 test cases. Duration: 121800ms
phi4-miniexaone-1.2bbenefit_classification
@beethovain0040d
5.8ms
judge (ensemble)
Blending: llama3kr-8b + exaone-1.2b. 21 test cases. Duration: 189000ms
llama3kr-8bexaone-1.2bbenefit_classification
@beethovain0040d
9ms
judge (ensemble)
Blending: llama3kr-8b + phi4-mini. 21 test cases. Duration: 403200ms
llama3kr-8bphi4-minibenefit_classification
@beethovain0040d
19.2ms
judge (ensemble)
Blending: exaone-7.8b + exaone-1.2b. 21 test cases. Duration: 220500ms
exaone-7.8bexaone-1.2bbenefit_classification
@beethovain0040d
10.5ms
judge (ensemble)
Blending: exaone-7.8b + phi4-mini. 21 test cases. Duration: 254100ms
exaone-7.8bphi4-minibenefit_classification
@beethovain0040d
12.1ms
judge (ensemble)
Blending: exaone-7.8b + llama3kr-8b. 21 test cases. Duration: 354900ms
exaone-7.8bllama3kr-8bbenefit_classification
@beethovain0040d
16.9ms
judge (solo)
Blending: gemma-1b. 21 test cases. Duration: 86100ms
gemma-1bbenefit_classification
@beethovain0040d
4.1ms
judge (solo)
Blending: exaone-2.4b. 21 test cases.
exaone-2.4bbenefit_classification
@beethovain0040d
1 models
judge (solo)
Blending: gemma-4b. 21 test cases. Duration: 136500ms
gemma-4bbenefit_classification
@beethovain0040d
6.5ms