Skip to content

Commit ce37364

Browse files
committed
minor: rephrase README, fix kvcache num_pages info
Signed-off-by: Frida Hou <[email protected]>
1 parent 053a075 commit ce37364

File tree

2 files changed

+7
-7
lines changed

2 files changed

+7
-7
lines changed

examples/auto_deploy/README.md

Lines changed: 6 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@ ______________________________________________________________________
1010

1111
## Quick Start
1212

13-
AutoDeploy is accessible through TRT-LLM installation.
13+
AutoDeploy is included with the TRT-LLM installation.
1414

1515
```bash
1616
sudo apt-get -y install libopenmpi-dev && pip3 install --upgrade pip setuptools && pip3 install tensorrt_llm
@@ -29,15 +29,15 @@ ______________________________________________________________________
2929

3030
## Example Run Script ([`build_and_run_ad.py`](./build_and_run_ad.py))
3131

32-
This script demonstrates end-to-end deployment of Hugging Face (or local) checkpoints using AutoDeploy’s graph-transformation pipeline.
32+
This script demonstrates end-to-end deployment of HuggingFace checkpoints using AutoDeploy’s graph-transformation pipeline.
3333

34-
You can arbitrarily configure your experiment. Use the `-h/--help` flag to see available options:
34+
You can configure your experiment with various options. Use the `-h/--help` flag to see available options:
3535

3636
```bash
3737
python build_and_run_ad.py --help
3838
```
3939

40-
Below is a non-exhaustive list of common config options:
40+
Below is a non-exhaustive list of common configuration options:
4141

4242
| Configuration Key | Description |
4343
|-------------------|-------------|
@@ -59,7 +59,7 @@ Below is a non-exhaustive list of common config options:
5959

6060
For default values and additional configuration options, refer to the [`ExperimentConfig`](./build_and_run_ad.py) class in [build_and_run_ad.py](./build_and_run_ad.py) file.
6161

62-
Here is a more complete example of using the script:
62+
The following is a more complete example of using the script:
6363

6464
```bash
6565
cd examples/auto_deploy
@@ -96,4 +96,4 @@ python lm_eval_ad.py \
9696

9797
## Disclaimer
9898

99-
This project is in active development and is currently in an early (beta) stage. The code is in prototype, subject to change, and may include backward-incompatible updates. While we strive for correctness, we provide no guarantees regarding functionality, stability, or reliability. Use at your own risk.
99+
This project is under active development and is currently in a prototype stage. The code is experimental, subject to change, and may include backward-incompatible updates. While we strive for correctness, there are no guarantees regarding functionality, stability, or reliability.

tensorrt_llm/_torch/auto_deploy/transform/library/kvcache.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -233,7 +233,7 @@ def _get_mem_info_in_mb():
233233
current_num_pages = cm.info.num_pages
234234
ad_logger.info(
235235
f"Current cache size (MB): {current_cache_size // 1024 // 1024}, "
236-
f"Current num pages (MB): {current_num_pages // 1024 // 1024}"
236+
f"Current num pages (MB): {current_num_pages}"
237237
)
238238

239239
if free_mem_ratio == 0.0:

0 commit comments

Comments
 (0)