[go: nahoru, domu]

Skip to content

Commit

Permalink
Update documentation #705
Browse files Browse the repository at this point in the history
  • Loading branch information
davidmezzetti committed Jun 4, 2024
1 parent 68fdc9c commit f28225b
Show file tree
Hide file tree
Showing 3 changed files with 21 additions and 2 deletions.
4 changes: 4 additions & 0 deletions docs/embeddings/configuration/general.md
Original file line number Diff line number Diff line change
Expand Up @@ -9,13 +9,17 @@ keyword: boolean

Enables sparse keyword indexing for this embeddings.

When enabled, this parameter creates a BM25 index for full text search. It also implicitly disables the [defaults](../vectors/#defaults) setting for vector search.

## hybrid
```yaml
hybrid: boolean
```

Enables hybrid (sparse + dense) indexing for this embeddings.

When enabled, this parameter creates a BM25 index for full text search. It has no effect on the [defaults](../vectors/#defaults) or [path](../vectors/#path) settings.

## indexes
```yaml
indexes: dict
Expand Down
7 changes: 7 additions & 0 deletions docs/embeddings/configuration/vectors.md
Original file line number Diff line number Diff line change
Expand Up @@ -10,6 +10,13 @@ path: string
Sets the path for a vectors model. When using a transformers/sentence-transformers model, this can be any model on the
[Hugging Face Hub](https://huggingface.co/models) or a local file path. Otherwise, it must be a local file path to a word embeddings model.

## defaults
```yaml
defaults: boolean
```

Uses default vector model path when enabled (default setting is True) and `path` is not provided. See [this link](../) for an example.

## method
```yaml
method: transformers|sentence-transformers|llama.cpp|litellm|external|words
Expand Down
12 changes: 10 additions & 2 deletions docs/faq.md
Original file line number Diff line number Diff line change
Expand Up @@ -91,7 +91,7 @@ SQLError: no such function: json_extract

__Solution__

Upgrade Python version as it doesn't have SQLite support for json_extract
Upgrade Python version as it doesn't have SQLite support for `json_extract`

----------

Expand All @@ -101,7 +101,15 @@ Segmentation faults and similar errors on macOS

__Solution__

Disable OpenMP threading via the environment variable `export OMP_NUM_THREADS=1` or downgrade PyTorch to <= 1.12. See issue [#377](https://github.com/neuml/txtai/issues/377) for more.
Set the following environment parameters.

- Disable OpenMP threading via the environment variable `export OMP_NUM_THREADS=1`
- Disable PyTorch MPS device via `export PYTORCH_MPS_DISABLE=1`
- Disable llama.cpp metal via `export LLAMA_NO_METAL=1`

If the issue is with a training pipeline.

- Disable GPU training via `export ACCELERATE_USE_CPU=1`

----------

Expand Down

0 comments on commit f28225b

Please sign in to comment.