Solidity LM surpasses Opus

Reddit r/LocalLLaMA / 5/6/2026

💬 OpinionSignals & Early TrendsTools & Practical UsageModels & Research

Key Points

  • The author reports a weekend project that resulted in a Solidity-focused language model, “Solidity LM,” outperforming “Opus” with a higher pass@1 score on the same task set.
  • The post notes that the model still needs additional work, and the author invites feedback from others.
  • The model is shared publicly via a Hugging Face link (Qwen3.6-Solidity-27B), indicating an intention to enable community testing and improvement.
  • The author emphasizes the personal time and cost invested in building and evaluating the model, highlighting the effort behind the benchmark comparison.

My weekend project overran a little but happy with the end result.

soleval pass@1 beat Opus 4.7 on the same set of tasks. Some more work to be done here but any feedback is welcome, I spent quite a lot of time (and money) on this one!

https://huggingface.co/samscrack/Qwen3.6-Solidity-27B

submitted by /u/swingbear
[link] [comments]