Hi everyone,
We are excited to share an experimental release from Prometech: Cicikus v3 Prometheus 4.4B.
This model is a targeted passthrough expansion of the Llama 3.2 3B architecture. Instead of a traditional merge, we identified "Hot Zones" through L2 norm analysis of trained adapters to expand the model to 40 layers (~4.42B parameters).
Key Features:
BCE Integration: Fine-tuned with our Behavioral Consciousness Engine for improved self-audit and reasoning.
Context: 32k token support.
Edge Optimized: Designed to run high-density reasoning tasks on consumer hardware (8GB Safetensors).
It is currently optimized for STEM and logical reasoning tasks. We are looking forward to community feedback and benchmarks.
Model Link: https://huggingface.co/pthinc/Cicikus_PTHS_v3_4.4B
[link] [comments]
