Victor Mustar's picture

Victor Mustar PRO

victor

·

victormustar

AI & ML interests

Building the UX of this website

Recent Activity

reacted to codelion's post with 🔥 1 day ago

I recently worked on a LoRA that improves tool use in LLM. Thought the approach might interest folks here. The issue I have had when trying to use some of the local LLMs with coding agents is this: Me: "Find all API endpoints with authentication in this codebase" LLM: "You should look for @app.route decorators and check if they have auth middleware..." But I often want it to search the files and show me but the LLM doesn't trigger a tool use call. To fine-tune it for tool use I combined two data sources: 1. Magpie scenarios - 5000+ diverse tasks (bug hunting, refactoring, security audits) 2. Real execution - Ran these on actual repos (FastAPI, Django, React) to get authentic tool responses This ensures the model learns both breadth (many scenarios) and depth (real tool behavior). Tools We Taught: - `read_file` - Actually read file contents - `search_files` - Regex/pattern search across codebases - `find_definition` - Locate classes/functions - `analyze_imports` - Dependency tracking - `list_directory` - Explore structure - `run_tests` - Execute test suites Improvements: - Tool calling accuracy: 12% → 80% - Correct parameters: 8% → 87% - Multi-step tasks: 3% → 78% - End-to-end completion: 5% → 80% - Tools per task: 0.2 → 3.8 The LoRA really improves on intential tool call as an example consider the query: "Find ValueError in payment module" The response proceeds as follows: 1. Calls `search_files` with pattern "ValueError" 2. Gets 4 matches across 3 files 3. Calls `read_file` on each match 4. Analyzes context 5. Reports: "Found 3 ValueError instances: payment/processor.py:47 for invalid amount, payment/validator.py:23 for unsupported currency..." Resources: - Colab notebook https://colab.research.google.com/github/codelion/ellora/blob/main/Ellora_Recipe_3_Enhanced_Tool_Calling_and_Code_Understanding.ipynb - Model - https://huggingface.co/codelion/Llama-3.2-1B-Instruct-tool-calling-lora - GitHub - https://github.com/codelion/ellora

liked a model 1 day ago

meituan-longcat/LongCat-Flash-Chat

liked a model 1 day ago

OpenGVLab/InternVL3_5-241B-A28B

View all activity

Organizations

victor 's models 41

victor/autotrain-satellite-image-classification-40975105875

Image Classification • Updated Mar 14, 2023 • 10 • 3

victor/ipynb-test

Updated Mar 2, 2023

victor/distilbert-base-uncased

Updated Jan 5, 2023

victor/test-model-3

Updated Jan 5, 2023

victor/autotrain-victormautotraindreambooth-FS8JGUBRYX-2450175922

Text-to-Image • Updated Dec 13, 2022

victor/1312312

Updated Oct 13, 2022

victor/titanic-survival-with-ml-console

Tabular Classification • Updated Oct 10, 2022 • 1

victor/autotrain-donut-vs-croissant-1417653460

Image Classification • Updated Sep 10, 2022 • 4 • 2

victor/test2

Updated May 13, 2022

victor/autonlp-imdb-reviews-sentiment-329982

Text Classification • Updated Jul 6, 2021 • 17

victor/animals-classifier

Image Classification • Updated Jun 29, 2021 • 7 • 1