• Avid Amoeba@lemmy.ca
    link
    fedilink
    arrow-up
    3
    arrow-down
    1
    ·
    8 days ago

    Local inference on AMD is getting crazy these days. 90-100tps decode for Qwen 3.8 Flash Next on a single R9700.