README参考文献与资料不同选项的实验环境基准(无微调,无量化)仅进行模型加载后的推理(inference)基准(全微调,无量化)基准(无微调,量化)模型加载后,通过 BitsAndBytes 实例设置以下超参数:超参数值load_in_4bitTruebnb_4bit_use_double_quantTruebnb_4bit_quant_typenf4bnb_4bit_compute_dtypebloat16基准(全微调,量化)LoRA(r=64, a=64)QLoRA(r=64, a=64)上一篇cdata-jdbc-mcp-server下一篇pdfsearch-zedNextpdfsearch-zedAuthor:waytomcpURL:https://www.waytomcp.com/article/Indigo-Coder-github/sLLMCopyright:All articles in this blog, except for special statements, adopt BY-NC-SA agreement. Please indicate the source!