[TokenMeter] Local ChatGPT (25.08)

This post was migrated from Tistory. You can find the original here.

TokenMeter

https://github.com/cornpip/TokenMeter

Feature

- crawling & summary

When you ask the GPT API to analyze a link, it often gives an odd answer based purely on whatever it can infer from the link text alone.

So for questions that contain a link, I added a feature that crawls the link, summarizes the page, and appends that summary to the question before sending it to the API.

The summarization model used is facebook/bart-large-cnn.

It can be toggled on/off in the settings.

On/off in settings

While crawling & summarizing: Searching web…

While waiting for the GPT API response: Please wait…

The summary is sent along with the question.

- Comparison with ChatGPT

ChatGPT’s responses are richer.

It doesn’t just crawl the link content — it also searches additional sites relevant to the context of the question, such as Wikipedia, Reddit, and Stack Overflow, to supplement the information.