大模型带我们来到了自然语言人机交互的时代

1、安装本地大模型进行推理

下载地址：
https://ollama.com/download
部署本地deepseek和嵌入模型

ollama run deepseek-r1:7b

2、制定Linux操作接口指令规范

3、编写大模型对话工具

#!/usr/bin/python3
#coding: utf-8import json
import requestsmodel = "llama3"def chat(messages):r = requests.post("http://localhost:11434/api/chat",json={"model": model, "messages": messages, "stream": True},)r.raise_for_status()output = ""for line in r.iter_lines():body = json.loads(line)if "error" in body:raise Exception(body["error"])if body.get("done") is False:message = body.get("message", "")content = message.get("content", "")output += contentprint(content, end="", flush=True)if body.get("done", False):message["content"] = outputreturn messagedef main():messages = []while True:user_input = input("Enter a prompt: ")if not user_input:exit()print()messages.append({"role": "user", "content": user_input})message = chat(messages)messages.append(message)print("\n\n")if __name__ == "__main__":main()

4、运行AI Agent查看效果

---

未完待续