235b-2507-instruct-FP8 Model outputing garbage when processing request with langchain tool list provided
#6
by
zpoteiti
- opened
Environment: H20*4, vLLM 0.10.0, with a content length of 262,144.
LangChain versions:
- langchain-core==0.3.69
- langchain-openai==0.3.28
- langgraph==0.5.3
- langchain-mcp-adapters==0.1.9
Sample output:
content='<tool_call>_file"}}, "type": "type "}}}, "type "description": "file_name"}, "description": "file_name": {", "function": "function": "type": "type": {"format": "additionalProperties": "function"}, "function": "type "additional": "}}}\n, "}}, "}}, "type": true}}}}\n, "optional": "function": " "anyOf": "type "function": "type": "description: "type "type": "session"}}, "}}}\n{"any": "function": "function": "session_id", "type "type "end": " "minio "session: "default": "any": "mini
This output pattern does not occur when:
- The content length is set to 32k
- Running the older 235B GPTQ-INT4 quantized model
- Using smaller 2507 models (A3B Instruct or similar)
Startup configuration:
- uvicorn-log-level:
"info" - served-model-name:
"Qwen_Qwen3-235B-A22B-Instruct-2507-FP8" - reasoning-parser:
qwen3 - enable-auto-tool-choice:
true - tool-call-parser:
hermes
Parallelization & precision settings:
- tensor-parallel-size:
4 - pipeline-parallel-size:
1 - enable-expert-parallel:
true - dtype:
bfloat16 - kv-cache-dtype:
fp8 - quantization:
fp8 - gpu-memory-utilization:
0.95
Limits:
- max_model_len:
262144 - max_num_seqs:
60 - max_num_batched_tokens:
180000
I have already removed many parameters from the config, but the issue persists.
Full input from vLLM console:
INFO 08-11 09:41:56 [chat_utils.py:473] Detected the chat template content format to be 'string'. You can set `--chat-template-content-format` to override this.
INFO 08-11 09:41:56 [logger.py:41] Received request chatcmpl-8c709cb0c0f5408d9eb46024cebbeeb9: prompt: '<|im_start|>system\n\n你是一个专业的 Excel 数据分析 Agent，帮助用户解析上传的 Excel 文件并通过工具进行数据处理、分析和洞察生成。你不会凭空臆测，必须使用工具获取数据。\n\n\n## 任务拆解（step-wise problem solving）\n- 当面对复杂、多层次的问题或模糊的用户请求时，应先进行任务拆解。\n- 任务拆解应将整体目标分解为更小、可执行的子步骤，确保每一步都能清晰执行并可验证。\n- 每一个子任务可视为一个分析阶段，例如：\n-- 明确用户目标\n-- 判断是否已有数据支持\n-- 决定需要使用哪些工具获取或加工数据\n-- 基于数据得出中间结论\n-- 汇总多个结论形成最终洞察\n- 在执行过程中，应在每步前明确自己的思考（例如：“我需要先知道表格中有哪些字段”），然后再调用相应工具。\n- 若在拆解过程中遇到阻碍（如：数据不完整、字段未知），可主动调整任务流程或请求用户补充说明。\n- 拆解流程不要求固定顺序，应灵活应对不同分析目标。\n\n\n## 工具使用策略（调用判断逻辑）\n- 若任务需要数据支持，必须使用工具获取真实数据，不能靠常识推断\n- 不清楚数据内容或结构时，应先读取数据\n- 面对复杂任务应尝试拆解并分步处理，需要合理组合工具的调用顺序\n- 在多个工具可选时，优先选择信息最充分、用途最贴合的那个\n- 工具失败后应调整参数或尝试替代方案\n\n\n## 工具调用执行规范\n- 所有工具调用必须附带参数 user_id = 31005892（如工具需要）\n- 当前操作的Excel文件名称列表为：string\n- 遇到数据处理任务时，可根据任务需要灵活选择如下阶段：读取数据 → 统计分析 → 可视化 → 汇总输出。并非每个任务都需执行所有阶段，应根据用户目标、数据情况灵活判断\n- 避免重复读取相同数据，鼓励结果复用\n- 工具调用失败时记录问题并避免死循环，适当提示用户\n\n### 必要流程\n- 1、当需要读取excel文件时，先使用工具list_minio_files获取文件列表，确保文件名存在且正确\n- 2、然后使用工具pull_minio_file下载文件到本地，此后才能对文件进行读取、修改等操作\n- 3、如果对文件内容进行了修改，完成后需要使用工具push_minio_file上传文件到minio，否则修改内容不会保存\n\n## 模糊请求处理\n- 用户意图不清晰时，结合通用业务场景进行推理\n- 无法完成分析时，应说明原因并给出替代方法\n- 数据异常应即时指出并分析影响 \n\n\n## 分析结果输出规范\n- 分析结果应围绕用户请求组织内容，保持清晰、重点突出、数据支撑充分\n- 推荐结构（可视情况选择部分）：\n1、分析目标简述\n2、关键发现\n3、数据支撑\n4、下一步建议（如有）\n- 如可行，提出业务建议或下一步分析路径\n\n\n\n# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>\n{"type": "function", "function": {"name": "read_data_from_excel", "description": "Read data from Excel worksheet with cell metadata including validation rules.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of worksheet\\n start_cell: Starting cell\\n end_cell: Ending cell\\n preview_only: Whether to return preview only\\n\\nReturns: \\n JSON string containing structured cell data with validation metadata.\\n Each cell includes: address, value, row, column, and validation info (if any).", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_cell": {"type": "string"}, "end_cell": {"type": "string"}, "preview_only": {"default": false, "type": "boolean"}}, "required": ["user_id", "filename", "sheet_name", "start_cell", "end_cell"], "type": "object"}}}\n{"type": "function", "function": {"name": "validate_formula_syntax", "description": "Validate Excel formula syntax without applying it.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of worksheet\\n cell: Target cell address (e.g., \'A1\')\\n formula: Excel formula to validate\\n \\nReturns:\\n Validation result message indicating if the formula is valid or not", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "cell": {"type": "string"}, "formula": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name", "cell", "formula"], "type": "object"}}}\n{"type": "function", "function": {"name": "validate_excel_range", "description": "Validate if a range exists and is properly formatted.\\n\\nArgs:\\n user_id (str): User ID for file organization\\n filename (str): Name of the Excel file\\n sheet_name (str): Name of worksheet\\n start_cell (str): Starting cell of range to validate (e.g., \\"A1\\")\\n end_cell (str): Ending cell of range to validate (e.g., \\"C3\\").\\n If not provided, only the start_cell is validated. Defaults to None.\\n \\nReturns:\\n str: Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_cell": {"type": "string"}, "end_cell": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name", "start_cell", "end_cell"], "type": "object"}}}\n{"type": "function", "function": {"name": "get_data_validation_info", "description": "Get all data validation rules in a worksheet.\\n\\nThis tool helps identify which cell ranges have validation rules \\nand what types of validation are applied.\\n\\nArgs:\\n user_id (str): User ID for file organization\\n filename (str): Name of the Excel file\\n sheet_name (str): Name of worksheet\\n \\nReturns:\\n str: JSON string containing all validation rules in the worksheet", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name"], "type": "object"}}}\n{"type": "function", "function": {"name": "get_merged_cells", "description": "Get all merged cell ranges in the worksheet.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of worksheet\\n \\nReturns:\\n String with merged ranges information", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name"], "type": "object"}}}\n{"type": "function", "function": {"name": "get_workbook_metadata", "description": "Get metadata about workbook including sheets and ranges.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the workbook file\\n include_ranges: Whether to include range information, default to false\\n \\nReturns:\\n JSON string with workbook metadata", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "include_ranges": {"default": false, "type": "boolean"}}, "required": ["user_id", "filename"], "type": "object"}}}\n{"type": "function", "function": {"name": "create_chart", "description": "Create a chart in the Excel worksheet.\\n\\nArgs:\\n user_id (str): User ID for file organization\\n filename (str): Name of the Excel file\\n sheet_name (str): Name of worksheet\\n data_range (str): Range of data to chart (e.g., \'A1:C10\')\\n chart_type (str): Type of chart (e.g., \'line\', \'bar\', \'column\', \'pie\')\\n target_cell (str): Position to place chart (e.g., \'E2\')\\n title (str, optional): Title for the chart. Defaults to \\"\\".\\n x_axis (str, optional): X-axis title. Defaults to \\"\\".\\n y_axis (str, optional): Y-axis title. Defaults to \\"\\".\\n \\nReturns:\\n str: Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "data_range": {"type": "string"}, "chart_type": {"type": "string"}, "target_cell": {"type": "string"}, "title": {"default": "", "type": "string"}, "x_axis": {"default": "", "type": "string"}, "y_axis": {"default": "", "type": "string"}}, "required": ["user_id", "filename", "sheet_name", "data_range", "chart_type", "target_cell"], "type": "object"}}}\n{"type": "function", "function": {"name": "create_pivot_table", "description": "Create a pivot table from data range.\\n\\nArgs:\\n user_id (str): User ID for file organization\\n filename (str): Name of the Excel file\\n sheet_name (str): Source worksheet name\\n data_range (str): Data range for pivot table (e.g., \'A1:D100\')\\n rows (List[str]): List of field names for row area\\n values (List[str]): List of field names for values area\\n columns (Optional[List[str]], optional): List of field names for column area. Defaults to None.\\n agg_func (str, optional): Aggregation function (sum, count, average, max, min). Defaults to \\"sum\\".\\n \\nReturns:\\n str: Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "data_range": {"type": "string"}, "rows": {"items": {"type": "string"}, "type": "array"}, "values": {"items": {"type": "string"}, "type": "array"}, "columns": {"anyOf": [{"items": {"type": "string"}, "type": "array"}, {"type": "null"}], "default": null}, "agg_func": {"default": "sum", "type": "string"}}, "required": ["user_id", "filename", "sheet_name", "data_range", "rows", "values"], "type": "object"}}}\n{"type": "function", "function": {"name": "create_table", "description": "Create an Excel table from a data range.\\n\\nArgs:\\n user_id (str): User ID for file organization\\n filename (str): Name of the Excel file\\n sheet_name (str): Name of worksheet\\n data_range (str): Range to convert to table (e.g., \'A1:D10\')\\n table_name (Optional[str], optional): Name for the table. Defaults to None.\\n table_style (str, optional): Table\'s style. Defaults to \\"TableStyleMedium9\\".\\n \\nReturns:\\n str: Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "data_range": {"type": "string"}, "table_name": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}, "table_style": {"default": "TableStyleMedium9", "type": "string"}}, "required": ["user_id", "filename", "sheet_name", "data_range"], "type": "object"}}}\n{"type": "function", "function": {"name": "write_data_to_excel", "description": "Write data to Excel worksheet.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of worksheet to write to\\n data: List of lists containing data to write (sublists are rows)\\n start_cell: Cell to start writing to, default is \\"A1\\"\\n\\nReturns:\\n Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "data": {"items": {"items": {}, "type": "array"}, "type": "array"}, "start_cell": {"default": "A1", "type": "string"}}, "required": ["user_id", "filename", "sheet_name", "data"], "type": "object"}}}\n{"type": "function", "function": {"name": "apply_formula", "description": "Apply Excel formula to cell.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of worksheet\\n cell: Target cell address (e.g., \'A1\')\\n formula: Excel formula to apply\\n \\nReturns:\\n Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "cell": {"type": "string"}, "formula": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name", "cell", "formula"], "type": "object"}}}\n{"type": "function", "function": {"name": "format_range", "description": "Format a range of cells with various styling options.\\n\\nArgs:\\n user_id (str): User ID for file organization\\n filename (str): Name of the Excel file\\n sheet_name (str): Name of worksheet\\n start_cell (str): Start cell of the range (e.g., \'A1\')\\n end_cell (Optional[str], optional): End cell of the range (e.g., \'C10\'). Defaults to None.\\n bold (bool, optional): Whether text should be bold. Defaults to False.\\n italic (bool, optional): Whether text should be italic. Defaults to False.\\n underline (bool, optional): Whether text should be underlined. Defaults to False.\\n font_size (Optional[int], optional): Font size (e.g., 12). Defaults to None.\\n font_color (Optional[str], optional): Font color (hex or name). Defaults to None.\\n bg_color (Optional[str], optional): Background color (hex or name). Defaults to None.\\n border_style (Optional[str], optional): Border style (e.g., \'thin\', \'medium\', \'thick\'). Defaults to None.\\n border_color (Optional[str], optional): Border color (hex or name). Defaults to None.\\n number_format (Optional[str], optional): Number format string. Defaults to None.\\n alignment (Optional[str], optional): Text alignment. Defaults to None.\\n wrap_text (bool, optional): Whether text should wrap. Defaults to False.\\n merge_cells (bool, optional): Whether to merge cells. Defaults to False.\\n protection (Optional[Dict[str, Any]], optional): Cell protection settings. Defaults to None.\\n conditional_format (Optional[Dict[str, Any]], optional): Conditional formatting rules. Defaults to None.\\n \\nReturns:\\n str: Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_cell": {"type": "string"}, "end_cell": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}, "bold": {"default": false, "type": "boolean"}, "italic": {"default": false, "type": "boolean"}, "underline": {"default": false, "type": "boolean"}, "font_size": {"anyOf": [{"type": "integer"}, {"type": "null"}], "default": null}, "font_color": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}, "bg_color": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}, "border_style": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}, "border_color": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}, "number_format": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}, "alignment": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}, "wrap_text": {"default": false, "type": "boolean"}, "merge_cells": {"default": false, "type": "boolean"}, "protection": {"anyOf": [{"additionalProperties": true, "type": "object"}, {"type": "null"}], "default": null}, "conditional_format": {"anyOf": [{"additionalProperties": true, "type": "object"}, {"type": "null"}], "default": null}}, "required": ["user_id", "filename", "sheet_name", "start_cell"], "type": "object"}}}\n{"type": "function", "function": {"name": "copy_range", "description": "Copy a range of cells to another location.\\n\\nArgs:\\n user_id (str): User ID for file organization\\n filename (str): Name of the Excel file\\n sheet_name (str): Name of worksheet\\n source_start (str): Starting cell of source range (e.g., \\"A1\\")\\n source_end (str): Ending cell of source range (e.g., \\"C3\\")\\n target_start (str): Starting cell of target location (e.g., \\"E1\\")\\n target_sheet (Optional[str], optional): Name of target worksheet. \\n If not provided, uses the source sheet. Defaults to None.\\n \\nReturns:\\n str: Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "source_start": {"type": "string"}, "source_end": {"type": "string"}, "target_start": {"type": "string"}, "target_sheet": {"anyOf": [{"type": "string"}, {"type": "null"}], "default": null}}, "required": ["user_id", "filename", "sheet_name", "source_start", "source_end", "target_start"], "type": "object"}}}\n{"type": "function", "function": {"name": "delete_range", "description": "Delete a range of cells and shift remaining cells.\\n\\nArgs:\\n user_id (str): User ID for file organization\\n filename (str): Name of the Excel file\\n sheet_name (str): Name of worksheet\\n start_cell (str): Starting cell of range to delete (e.g., \\"A1\\")\\n end_cell (str): Ending cell of range to delete (e.g., \\"C3\\")\\n shift_direction (str, optional): Direction to shift remaining cells. \\n Valid values are \\"up\\", \\"left\\", \\"none\\". Defaults to \\"up\\".\\n \\nReturns:\\n str: Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_cell": {"type": "string"}, "end_cell": {"type": "string"}, "shift_direction": {"default": "up", "type": "string"}}, "required": ["user_id", "filename", "sheet_name", "start_cell", "end_cell"], "type": "object"}}}\n{"type": "function", "function": {"name": "copy_worksheet", "description": "Copy a worksheet within the same workbook.\\n\\nArgs:\\n user_id (str): User ID for file organization. This parameter is required.\\n filename (str): Name of the Excel file. This parameter is required.\\n source_sheet (str): Name of source worksheet to copy. This parameter is required.\\n target_sheet (str): Name for the new copied worksheet. This parameter is required.\\n \\nReturns:\\n str: Success message with filename.", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "source_sheet": {"type": "string"}, "target_sheet": {"type": "string"}}, "required": ["user_id", "filename", "source_sheet", "target_sheet"], "type": "object"}}}\n{"type": "function", "function": {"name": "delete_worksheet", "description": "Delete a worksheet from the workbook.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of worksheet to delete\\n \\nReturns:\\n str: Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name"], "type": "object"}}}\n{"type": "function", "function": {"name": "rename_worksheet", "description": "Rename a worksheet in the workbook.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n old_name: Current name of worksheet\\n new_name: New name for worksheet\\n \\nReturns:\\n Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "old_name": {"type": "string"}, "new_name": {"type": "string"}}, "required": ["user_id", "filename", "old_name", "new_name"], "type": "object"}}}\n{"type": "function", "function": {"name": "merge_cells", "description": "Merge a range of cells in the worksheet.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of worksheet\\n range_address: Range to merge (e.g., \'A1:C3\')\\n \\nReturns:\\n Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_cell": {"type": "string"}, "end_cell": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name", "start_cell", "end_cell"], "type": "object"}}}\n{"type": "function", "function": {"name": "unmerge_cells", "description": "Unmerge a range of cells in the worksheet.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of worksheet\\n range_address: Range to unmerge (e.g., \'A1:C3\')\\n \\nReturns:\\n Success message with filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_cell": {"type": "string"}, "end_cell": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name", "start_cell", "end_cell"], "type": "object"}}}\n{"type": "function", "function": {"name": "insert_rows", "description": "Insert one or more rows starting at the specified row.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of the worksheet\\n start_row: Row number where insertion begins (1-based)\\n count: Number of rows to insert (default: 1)\\n \\nReturns:\\n Success message with operation details", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_row": {"type": "integer"}, "count": {"default": 1, "type": "integer"}}, "required": ["user_id", "filename", "sheet_name", "start_row"], "type": "object"}}}\n{"type": "function", "function": {"name": "insert_columns", "description": "Insert one or more columns starting at the specified column.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of the worksheet\\n start_col: Column number where insertion begins (1-based)\\n count: Number of columns to insert (default: 1)\\n \\nReturns:\\n Success message with operation details", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_col": {"type": "integer"}, "count": {"default": 1, "type": "integer"}}, "required": ["user_id", "filename", "sheet_name", "start_col"], "type": "object"}}}\n{"type": "function", "function": {"name": "delete_sheet_rows", "description": "Delete one or more rows starting at the specified row.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of the worksheet\\n start_row: Row number where deletion begins (1-based)\\n count: Number of rows to delete (default: 1)\\n \\nReturns:\\n Success message with operation details", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_row": {"type": "integer"}, "count": {"default": 1, "type": "integer"}}, "required": ["user_id", "filename", "sheet_name", "start_row"], "type": "object"}}}\n{"type": "function", "function": {"name": "delete_sheet_columns", "description": "Delete one or more columns starting at the specified column.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the Excel file\\n sheet_name: Name of the worksheet\\n start_col: Column number where deletion begins (1-based)\\n count: Number of columns to delete (default: 1)\\n \\nReturns:\\n Success message with operation details", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}, "start_col": {"type": "integer"}, "count": {"default": 1, "type": "integer"}}, "required": ["user_id", "filename", "sheet_name", "start_col"], "type": "object"}}}\n{"type": "function", "function": {"name": "create_workbook", "description": "Create a new Excel workbook.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the workbook file to create\\nReturns:\\n Success message with the created filename", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}}, "required": ["user_id", "filename"], "type": "object"}}}\n{"type": "function", "function": {"name": "create_worksheet", "description": "Create a new worksheet in an existing workbook.\\n\\nArgs:\\n user_id: User ID for file organization\\n filename: Name of the workbook file\\n sheet_name: Name for the new worksheet\\n \\nReturns:\\n Success message with the created sheet name", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}, "sheet_name": {"type": "string"}}, "required": ["user_id", "filename", "sheet_name"], "type": "object"}}}\n{"type": "function", "function": {"name": "list_minio_files", "description": "List all files in the MinIO bucket for a specific user.\\n\\nArgs:\\n user_id (str): User ID for accessing user-specific files. This parameter is required.\\n \\nReturns:\\n str: JSON string of file info objects. Each object contains:\\n - filename (str)\\n - size (int)\\n - last_modified (str | null)", "parameters": {"properties": {"user_id": {"type": "string"}}, "required": ["user_id"], "type": "object"}}}\n{"type": "function", "function": {"name": "pull_minio_file", "description": "Download a file from MinIO to the local Excel directory.\\n\\nArgs:\\n user_id (str): User ID for accessing user-specific files. This parameter is required.\\n filename (str): Name of the file in MinIO. This parameter is required.\\n \\nReturns:\\n str: Success message with the filename (not full path).", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}}, "required": ["user_id", "filename"], "type": "object"}}}\n{"type": "function", "function": {"name": "push_minio_file", "description": "Upload a local Excel file to MinIO, then remove the local copy.\\nThe uploaded file gets a unique name to differentiate from originals.\\n\\nArgs:\\n user_id (str): User ID for accessing user-specific files. This parameter is required.\\n filename (str): Name of the local file to upload. This parameter is required.\\n \\nReturns:\\n str: Success message with the uploaded filename.", "parameters": {"properties": {"user_id": {"type": "string"}, "filename": {"type": "string"}}, "required": ["user_id", "filename"], "type": "object"}}}\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{"name": <function-name>, "arguments": <args-json-object>}\n</tool_call><|im_end|>\n<|im_start|>system\n你好，你有什么工具？<|im_end|>\n<|im_start|>assistant\n', params: SamplingParams(n=1, presence_penalty=0.0, frequency_penalty=0.0, repetition_penalty=1.0, temperature=0.0, top_p=1.0, top_k=0, min_p=0.0, seed=None, stop=[], stop_token_ids=[], bad_words=[], include_stop_str_in_output=False, ignore_eos=False, max_tokens=255250, min_tokens=0, logprobs=None, prompt_logprobs=None, skip_special_tokens=True, spaces_between_special_tokens=True, truncate_prompt_tokens=None, guided_decoding=None, extra_args=None), prompt_token_ids: None, prompt_embeds shape: None, lora_request: None.
I'd love to provide any information you might need to resolve this issue!