How to set Repetition penalty? #1104
              
                Unanswered
              
          
                  
                    
                      vijaysridhara
                    
                  
                
                  asked this question in
                Q&A
              
            Replies: 1 comment
-
| All the sampling parameters are properties of the sampling pipeline. See here for an example (in this case setting temp). There are various other properties on the  | 
Beta Was this translation helpful? Give feedback.
                  
                    0 replies
                  
                
            
  
    Sign up for free
    to join this conversation on GitHub.
    Already have an account?
    Sign in to comment
  
        
    
Uh oh!
There was an error while loading. Please reload this page.
-
This is related to my previous question, as the Deepseek V2 is constantly repeating same response many times, over one asked question. Is there a possibility of setting repetition penalty?
Beta Was this translation helpful? Give feedback.
All reactions