Fixed proxy format and some typos
parent
3ec5e79958
commit
cc5dcd278d
1 changed files with 5 additions and 5 deletions
10
Config.md
10
Config.md
|
@ -42,12 +42,12 @@ This page documents all configuration variables available in `config.ini`, inclu
|
||||||
|
|
||||||
### Notes:
|
### Notes:
|
||||||
|
|
||||||
- Proxies must be specified as a **comma-separated list**.
|
- Proxies must be specified as a **comma-separated list**, dont use comma with space behind it.
|
||||||
- Each proxy should be in the format:
|
- Each proxy should be in the format:
|
||||||
- `ADDRESS:PORT`
|
- `ADDRESS:PORT`
|
||||||
- `ADDRESS:PORT:USER:PASSWORD`
|
- `ADDRESS:PORT:USER:PASSWORD`
|
||||||
- Example:
|
- Example:
|
||||||
- `proxy1.example.com:8080:user1:pass1, proxy2.example.com:8080`
|
- `proxy1.example.com:8080:user1:pass1,proxy2.example.com:8080`
|
||||||
|
|
||||||
## Crawling and Indexing
|
## Crawling and Indexing
|
||||||
|
|
||||||
|
@ -55,7 +55,7 @@ This page documents all configuration variables available in `config.ini`, inclu
|
||||||
| ------------------------------ | --------------------------------------------- | ------------------- | ----------------------------------- |
|
| ------------------------------ | --------------------------------------------- | ------------------- | ----------------------------------- |
|
||||||
| `ConcurrentStandardCrawlers` | Number of standard crawlers running at once | `12` | Positive number |
|
| `ConcurrentStandardCrawlers` | Number of standard crawlers running at once | `12` | Positive number |
|
||||||
| `ConcurrentChromeCrawlers` | Number of Chrome-based crawlers running | `4` | Positive number |
|
| `ConcurrentChromeCrawlers` | Number of Chrome-based crawlers running | `4` | Positive number |
|
||||||
| `CrawlingInterval` | Time between refreshing crawled results | `24h` | Duration like`1h`, `30m`, `2h45m` |
|
| `CrawlingInterval` | Time between refreshing crawled results | `24h` | Duration like `1h`, `30m`, `2h45m` |
|
||||||
| `MaxPagesPerDomain` | Maximum pages to crawl per domain | `10` | Positive number |
|
| `MaxPagesPerDomain` | Maximum pages to crawl per domain | `10` | Positive number |
|
||||||
| `IndexBatchSize` | Number of pages to index in one batch | `50` | Positive number |
|
| `IndexBatchSize` | Number of pages to index in one batch | `50` | Positive number |
|
||||||
|
|
||||||
|
@ -65,13 +65,13 @@ This page documents all configuration variables available in `config.ini`, inclu
|
||||||
|
|
||||||
| **Variable** | **Description** | **Default Value** | **Possible Values** |
|
| **Variable** | **Description** | **Default Value** | **Possible Values** |
|
||||||
| -------------- | ------------------------------ | ------------------- | ----------------------------------------- |
|
| -------------- | ------------------------------ | ------------------- | ----------------------------------------- |
|
||||||
| `Duration` | Time to store results in RAM | `6h` | Duration like`1h`, `30m`, `2h45m` |
|
| `Duration` | Time to store results in RAM | `6h` | Duration like `1h`, `30m`, `2h45m` |
|
||||||
| `MaxUsage` | Maximum RAM usage | `90%` | Percentage (`%`) or size (e.g., `2GiB`) |
|
| `MaxUsage` | Maximum RAM usage | `90%` | Percentage (`%`) or size (e.g., `2GiB`) |
|
||||||
|
|
||||||
### Drive Cache
|
### Drive Cache
|
||||||
|
|
||||||
| **Variable** | **Description** | **Default Value** | **Possible Values** |
|
| **Variable** | **Description** | **Default Value** | **Possible Values** |
|
||||||
| -------------- | ---------------------------------- | ------------------- | ------------------------------------------ |
|
| -------------- | ---------------------------------- | ------------------- | ------------------------------------------ |
|
||||||
| `Duration` | Time to store results on disk | `48h` | Duration like`1h`, `30m`, `2h45m` |
|
| `Duration` | Time to store results on disk | `48h` | Duration like `1h`, `30m`, `2h45m` |
|
||||||
| `MaxUsage` | Maximum disk usage | `90%` | Percentage (`%`) or size (e.g., `10GiB`) |
|
| `MaxUsage` | Maximum disk usage | `90%` | Percentage (`%`) or size (e.g., `10GiB`) |
|
||||||
| `Path` | Path to the disk cache directory | `./cache` | Any valid file path |
|
| `Path` | Path to the disk cache directory | `./cache` | Any valid file path |
|
||||||
|
|
Loading…
Add table
Reference in a new issue