Update README.md
Browse files
README.md
CHANGED
@@ -770,9 +770,8 @@ The GitHub Crawl was collected using the GitHub REST API and the Amazon S3 API.
|
|
770 |
|
771 |
## Inference
|
772 |
|
773 |
-
-
|
774 |
-
|
775 |
-
- ## Test Hardware NVIDIA A10G 24GB, H100 80GB, Jetson AGX Thor
|
776 |
|
777 |
## Ethical Considerations
|
778 |
|
|
|
770 |
|
771 |
## Inference
|
772 |
|
773 |
+
- Engines: HF, vLLM, TRT-LLM
|
774 |
+
- Test Hardware NVIDIA A10G 24GB, H100 80GB, Jetson AGX Thor
|
|
|
775 |
|
776 |
## Ethical Considerations
|
777 |
|