Skip to content

Commit e9246f0

Browse files
committed
Add base converter implementation with registry and adapt entrypoints/CLI to utilize it
1 parent 6e27c36 commit e9246f0

File tree

2 files changed

+3
-2
lines changed

2 files changed

+3
-2
lines changed

src/speculators/__main__.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -136,7 +136,8 @@ def convert(
136136
--verifier "meta-llama/Llama-3.1-8B-Instruct"
137137
138138
# eagle3 with normalization before the residual
139-
--algorithm-kwargs '{"norm_before_residual": true}' \
139+
speculators convert "./eaglev3/checkpoint" \
140+
--algorithm-kwargs '{"norm_before_residual": true}'
140141
--verifier "meta-llama/Llama-3.1-8B-Instruct"
141142
142143
:param model: Model checkpoint path or Hugging Face model ID to convert

src/speculators/convert/converters/base.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -30,7 +30,7 @@
3030
"""Generic type variable for speculator models"""
3131

3232

33-
class SpeculatorConverter(ABC, RegistryMixin, Generic[ConfigT, ModelT]):
33+
class SpeculatorConverter(ABC, Generic[ConfigT, ModelT], RegistryMixin):
3434
"""
3535
Abstract base converter for transforming external checkpoints to Speculators format.
3636

0 commit comments

Comments
 (0)