[doc][distributed] add suggestion for distributed inference

[youkaichao]

No description provided.

[github-actions]

👋 Hi! Thank you for contributing to the vLLM project.
Just a reminder: PRs would not trigger full CI run by default. Instead, it would only trigger fastcheck CI to run, which consists only a small and essential subset of tests to quickly catch errors with the flexibility to run extra individual tests on top (you can do this by unblocking test steps in the Buildkite run).

Full CI run is still required to merge this PR so once the PR is ready to go, please make sure to run it. If you need all test signals in between PR commits, you can trigger full CI as well.

To run full CI, you can do one of these:

• Comment /ready on the PR
• Add ready label to the PR
• Enable auto-merge.

🚀

[simon-mo]

If users want to increase the throughput and lower the latency of a small model, they should also use TP

[youkaichao]

If users want to increase the throughput and lower the latency of a small model, they should also use TP

true (mainly for increasing throughput I think). added in 0d99585