[web ui] LLaMA 성능
·
IT/Web UI
과연 얼마나 퍼포먼스를 견딜까? Output generated in 39.19 seconds (2.04 tokens/s, 80 tokens, context 1571) Output generated in 60.85 seconds (2.28 tokens/s, 139 tokens, context 1675)