/4 Adding Flexibility – Supporting Multiple LLM Models (Solidsight v8)

Search for a command to run...

No comments yet. Be the first to comment.
In this series, I will venture the down a path of development using various languages, mainly Python, and utilise AI for the majority if not all of the code generation.
Rationale for Session Management As Solidsight's capabilities expanded, managing historical analysis data became increasingly important. The next logical step was introducing structured session management, allowing users to revisit previous analyses ...
The Need for Rigorous Validation As Solidsight matured, accuracy became paramount. One key improvement was ensuring generated Mermaid diagrams were accurate and meaningful, addressing the occasional production of invalid placeholder diagrams by the L...

Rationale for Session Management As Solidsight's capabilities expanded, managing historical analysis data became increasingly important. The next logical step was introducing structured session management, allowing users to revisit previous analyses ...

Overview Versions 4 and 5 saw significant strides in workflow optimisation, making the SFA more practical and user-friendly. Efficiency and redundancy elimination became central to these iterations. Duplicates A key feature introduced was a robust du...

Motivation for Change Although Solidsight was becoming powerful, its plain text outputs lacked readability. To address this, I integrated the Rich library, significantly enhancing the visual appeal and clarity of the command-line interface. Implemen...

Smart contract analyses can vary greatly in complexity and purpose. Realising this, I added support for multiple LLM models, allowing users to tailor analyses according to specific needs. This flexibility transformed Solidsight into a much more versatile tool.
I introduced a simple yet effective model-selection prompt using Rich:
pythonCopyEditanalysis_model = Prompt.ask(
"Select your analysis model",
choices=["deepseek-r1", "qwen2.5-coder:3b", "gemma3:4b"],
default="deepseek-r1"
)
Different models required slight prompt adjustments due to their varied interpretations and output formats. It took careful prompt engineering and extensive testing to achieve consistency across models.
The value of modular design became clear—flexibility allowed Solidsight to adapt easily to varying analysis requirements.
We will stop here, and I’ll see you on the next one.
pxng0lin.