??spring-ai-alibaba
?是Spring AI生態里與阿里巴巴相關的組件,借助它能夠實現接入各類大模型。以下為你詳細介紹如何使用?spring-ai-alibaba
?接入不同大模型:
接入open ai
項目環境準備
????????首先要創建一個Spring Boot項目,并且在?pom.xml
?里添加必要的依賴。接入openapi為例(我這里使用硅基流動和openapi一樣)官網:SiliconFlow
<?xml version="1.0" encoding="UTF-8"?>
<project xmlns="http://maven.apache.org/POM/4.0.0" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 https://maven.apache.org/xsd/maven-4.0.0.xsd"><modelVersion>4.0.0</modelVersion><parent><groupId>org.springframework.boot</groupId><artifactId>spring-boot-starter-parent</artifactId><version>3.5.0</version><relativePath/> <!-- lookup parent from repository --></parent><groupId>com.sqz</groupId><artifactId>spring-ai-deepseek</artifactId><version>0.0.1-SNAPSHOT</version><name>spring-ai-deepseek</name><description>spring-ai-deepseek</description><url/><licenses><license/></licenses><developers><developer/></developers><scm><connection/><developerConnection/><tag/><url/></scm><properties><java.version>21</java.version></properties><dependencies><dependency><groupId>org.springframework.boot</groupId><artifactId>spring-boot-starter-web</artifactId></dependency><!--接入openapi--><dependency><groupId>org.springframework.ai</groupId><artifactId>spring-ai-openai-spring-boot-starter</artifactId><version>1.0.0-M6</version></dependency><!--接入ollama--><!--<dependency><groupId>org.springframework.ai</groupId><artifactId>spring-ai-ollama-spring-boot-starter</artifactId><version>1.0.0-M6</version></dependency>--><!--接入 通義千問--><!-- <dependency><groupId>com.alibaba.cloud.ai</groupId><artifactId>spring-ai-alibaba-starter</artifactId><version>1.0.0-M6.1</version></dependency>--><dependency><groupId>org.projectlombok</groupId><artifactId>lombok</artifactId></dependency><dependency><groupId>org.springframework.boot</groupId><artifactId>spring-boot-starter-test</artifactId><scope>test</scope></dependency></dependencies><build><plugins><plugin><groupId>org.springframework.boot</groupId><artifactId>spring-boot-maven-plugin</artifactId></plugin></plugins></build><repositories><repository><id>spring-milestones</id><name>Spring Milestones</name><url>https://repo.spring.io/milestone</url><snapshots><enabled>false</enabled></snapshots></repository><repository><id>spring-snapshots</id><name>Spring Snapshots</name><url>https://repo.spring.io/snapshot</url><releases><enabled>false</enabled></releases></repository><repository><id>aliyunmaven</id><name>aliyun</name><url>https://maven.aliyun.com/repository/public</url></repository></repositories><pluginRepositories><pluginRepository><id>public</id><name>aliyun nexus</name><url>https://maven.aliyun.com/repository/public</url><releases><enabled>true</enabled></releases><snapshots><enabled>false</enabled></snapshots></pluginRepository></pluginRepositories>
</project>
配置認證信息
在?application.properties
?或者?application.yml
?中配置硅基流動認證信息,例如:
spring:application:name: alibaba-ai-demoai:openai:api-key: your-api-key #apiKey到硅基流動官網獲取免費的base-url: https://api.siliconflow.cnchat:options:model: Qwen/QwQ-32B #使用通義千問模型
這里的?your-api-key
?要替換成自己獲取的API Key。
?編寫代碼接入大模型
下面是一個簡單的Java代碼示例,展示了如何使用?spring-ai-alibaba
?接入openapi模型:
package com.sqz.springaideepseek.controller;import org.springframework.ai.chat.client.ChatClient;
import org.springframework.http.MediaType;
import org.springframework.http.codec.ServerSentEvent;
import org.springframework.web.bind.annotation.GetMapping;
import org.springframework.web.bind.annotation.RequestParam;
import org.springframework.web.bind.annotation.RestController;
import reactor.core.publisher.Flux;@RestController
public class ChatController {private final ChatClient chatClient;public ChatController(ChatClient.Builder builder) {this.chatClient = builder.defaultSystem("你是一個萬能助手,你可以回答任何問題。").build();}@GetMapping("/chat")public String chat(@RequestParam(value = "input") String input) {return this.chatClient.prompt().user(input).call().content();}/*** ChatClient 流式響應*/@GetMapping(value = "/stream/response", produces = "text/event-stream;charset=UTF-8")public Flux<ServerSentEvent<String>> simpleChat(@RequestParam String message) {return chatClient.prompt().user(message).stream().content().map(content -> ServerSentEvent.<String>builder().data(content).build());}
}
測試:http://localhost:8080/chat?input=%E4%BD%A0%E6%98%AF%E8%B0%81
接入ollama?
將配置文件改為ollama配置:
spring:application:name: alibaba-ai-demoai:ollama:base-url: http://localhost:11434chat:model: deepseek-r1:1.5b
pom文件注釋掉openapi,依賴 放開ollama注釋
<!--接入openapi--><!--<dependency><groupId>org.springframework.ai</groupId><artifactId>spring-ai-openai-spring-boot-starter</artifactId><version>1.0.0-M6</version></dependency>--><!--接入ollama--><dependency><groupId>org.springframework.ai</groupId><artifactId>spring-ai-ollama-spring-boot-starter</artifactId><version>1.0.0-M6</version></dependency>
接入阿里云大模型
pom文件注釋掉openapi和ollama,打開alibaba
<dependency><groupId>com.alibaba.cloud.ai</groupId><artifactId>spring-ai-alibaba-starter</artifactId><version>1.0.0-M6.1</version>
</dependency>
修改配置文件
spring:application:name: alibaba-ai-demoai:dashscope:api-key: your-api-key
這里的?your-api-key
?要替換成你自己在阿里云獲取的API Key。就可以測試了