update scraping section of readme

このコミットが含まれているのは:
Arya Kiran 2023-03-07 18:05:57 +05:30
コミット 5a262053c1
この署名に対応する既知のキーがデータベースに存在しません
GPGキーID: 842D12BDA50DF120
1個のファイルの変更9行の追加1行の削除

ファイルの表示

@ -30,6 +30,8 @@ The ``master`` branch runs on the master branch of GotHub. This means that the i
Have an instance you want on the list? Make an issue or PR!
You can find a json-list of the same in [gothub/gothub-instances](https://codeberg.org/gothub/gothub-instances).
[^1]: Has some modifications: https://git.vern.cc/vern/modifications/src/branch/master/gothub
## Setup
@ -64,7 +66,13 @@ gothub.example.com {
}
```
## Scraping
Variables: 1) GOTHUB_USER_AGENT - Sets the User Agent to use for making the requests. Defaults to Chrome 110 on Windows 10.
Other than for the explore page, gothub uses scraping in order to retrieve the information.
This makes it hard for gothub to get ratelimited.
You can also set the GOTHUB_USER_AGENT envvar in order to set the user agent with which GotHub makes requests to Github.
By default, we use the user agent of Chrome 110 on Windows 10.
## DMCA/Legal notice