What is chat Context Limit

The Chat Context Limit option allows you to configure how big the conversation you want to send to a large language model for evaluation.

Which option should I use

It depends on your goal. Generally, giving AI more context (longer conversation) might improve the answer's relevancy. However, it would use more tokens and thus, may incur more fee.

In PDF Pals, you can choose to use all previous messages as the chat context, or you can choose a specific number of messages (0 - 10)

How do I change the Context Limit in PDF Pals

To change the Context Limit in PDF Pals, open the Chat Configuration Panel, choose the Advanced tab > Context Limit

If you are new here, PDF Pals is a native macOS app that allows you to chat with local PDFs instantly. Download now.