越来越多的现代应用开始集成大型语言模型（LLM），以构建更智能的功能。如何使用Spring AI快速整合LLM能力到自己的Spring Boot应用，在之前的博文中有过很多篇关于使用Spring AI使用不同供应商LLM的整合案例。虽然一个 LLM 能胜任多种任务，但只依赖单一模型并不总是最优。

不同模型各有侧重：有的擅长技术分析，有的更适合创意写作。简单任务更适合轻量、性价比高的模型；复杂任务则交给更强大的模型。

本文将演示如何借助 Spring AI，在 Spring Boot 应用中集成多个 LLM。

我们既会配置来自不同供应商的模型，也会配置同一供应商下的多个模型。随后基于这些配置，构建一个具备弹性的聊天机器人，在故障时可自动在模型间切换。

2. 配置不同供应商的 LLM

我们先在应用中配置来自不同供应商的两个 LLM。

在本文示例中，我们将使用 OpenAI 和 Anthropic 作为 AI 模型提供商。

2.1. 配置主 LLM

我们先将一个 OpenAI 模型配置为主 LLM。

首先，在项目的 pom.xml 文件中添加所需依赖：

<dependency>
    <groupId>org.springframework.ai</groupId>
    <artifactId>spring-ai-starter-model-openai</artifactId>
    <version>1.0.2</version>
</dependency>

该 OpenAI Starter 依赖 是对 OpenAI Chat Completions API 的封装，使我们能够在应用中与 OpenAI 模型交互。

接着，在 application.yaml 中配置我们的 OpenAI API Key 和聊天模型：

spring:
  ai:
    open-ai:
      api-key: ${OPENAI_API_KEY}
      chat:
        options:
          model: ${PRIMARY_LLM}
          temperature: 1

我们使用 ${} 属性占位符从环境变量中加载属性值。另外，我们将温度设置为 1，因为较新的 OpenAI 模型只接受这个默认值。

在完成上述属性配置后，Spring AI 会自动创建一个 OpenAiChatModel 类型的 bean。我们使用它来定义一个 ChatClient bean，作为与 LLM 交互的主要入口：

@Configuration
class ChatbotConfiguration {

    @Bean
    @Primary
    ChatClient primaryChatClient(OpenAiChatModel chatModel) {
        return ChatClient.create(chatModel);
    }
}

在 ChatbotConfiguration 类中，我们使用 OpenAiChatModel bean 创建了主 LLM 的 ChatClient。

我们使用 @Primary 注解标记该 bean。当在组件中注入 ChatClient 且未使用 Qualifier 时，Spring Boot 会自动注入它。

https://zq.zhaopin.com/moment/55733492
https://zq.zhaopin.com/moment/55733382
https://zq.zhaopin.com/moment/55733505
https://zq.zhaopin.com/moment/55733517
https://zq.zhaopin.com/moment/55733592
https://zq.zhaopin.com/moment/55733591
https://zq.zhaopin.com/moment/55733599
https://zq.zhaopin.com/moment/55733257
https://zq.zhaopin.com/moment/55733512
https://zq.zhaopin.com/moment/55733335
https://zq.zhaopin.com/moment/55733510
https://zq.zhaopin.com/moment/55733416
https://zq.zhaopin.com/moment/55733417
https://zq.zhaopin.com/moment/55733436
https://zq.zhaopin.com/moment/55733420
https://zq.zhaopin.com/moment/55733538
https://zq.zhaopin.com/moment/55733556
https://zq.zhaopin.com/moment/55733551
https://zq.zhaopin.com/moment/55733189
https://zq.zhaopin.com/moment/55733453
https://zq.zhaopin.com/moment/55733479
https://zq.zhaopin.com/moment/55732886
https://zq.zhaopin.com/moment/55733575
https://zq.zhaopin.com/moment/55733670
https://zq.zhaopin.com/moment/55733092
https://zq.zhaopin.com/moment/55733468
https://zq.zhaopin.com/moment/55733476
https://zq.zhaopin.com/moment/55733559
https://zq.zhaopin.com/moment/55733566
https://zq.zhaopin.com/moment/55733572
https://zq.zhaopin.com/moment/55733569
https://zq.zhaopin.com/moment/55733581
https://zq.zhaopin.com/moment/55733495
https://zq.zhaopin.com/moment/55733620
https://zq.zhaopin.com/moment/55733632
https://zq.zhaopin.com/moment/55733616
https://zq.zhaopin.com/moment/55733440
https://zq.zhaopin.com/moment/55733617
https://zq.zhaopin.com/moment/55733613
https://zq.zhaopin.com/moment/55733605
https://zq.zhaopin.com/moment/55733621
https://zq.zhaopin.com/moment/55733644
https://zq.zhaopin.com/moment/55733336
https://zq.zhaopin.com/moment/55733552
https://zq.zhaopin.com/moment/55733652
https://zq.zhaopin.com/moment/55733642
https://zq.zhaopin.com/moment/55733553
https://zq.zhaopin.com/moment/55733669
https://zq.zhaopin.com/moment/55733682
https://zq.zhaopin.com/moment/55733674
https://zq.zhaopin.com/moment/55733611
https://zq.zhaopin.com/moment/55733704
https://zq.zhaopin.com/moment/55733708
https://zq.zhaopin.com/moment/55733686
https://zq.zhaopin.com/moment/55733393
https://zq.zhaopin.com/moment/55733693
https://zq.zhaopin.com/moment/55733689
https://zq.zhaopin.com/moment/55733700
https://zq.zhaopin.com/moment/55733710
https://zq.zhaopin.com/moment/55733688
https://zq.zhaopin.com/moment/55733587
https://zq.zhaopin.com/moment/55733701
https://zq.zhaopin.com/moment/55733716
https://zq.zhaopin.com/moment/55733607
https://zq.zhaopin.com/moment/55733731
https://zq.zhaopin.com/moment/55733740
https://zq.zhaopin.com/moment/55733666
https://zq.zhaopin.com/moment/55733635
https://zq.zhaopin.com/moment/55733751
https://zq.zhaopin.com/moment/55733725
https://zq.zhaopin.com/moment/55733752
https://zq.zhaopin.com/moment/55733561
https://zq.zhaopin.com/moment/55733741
https://zq.zhaopin.com/moment/55733392
https://zq.zhaopin.com/moment/55733531
https://zq.zhaopin.com/moment/55733742
https://zq.zhaopin.com/moment/55733648
https://zq.zhaopin.com/moment/55733735
https://zq.zhaopin.com/moment/55733371
https://zq.zhaopin.com/moment/55733764
https://zq.zhaopin.com/moment/55733622
https://zq.zhaopin.com/moment/55733743
https://zq.zhaopin.com/moment/55733723
https://zq.zhaopin.com/moment/55733739
https://zq.zhaopin.com/moment/55733801
https://zq.zhaopin.com/moment/55733774
https://zq.zhaopin.com/moment/55733683
https://zq.zhaopin.com/moment/55733769
https://zq.zhaopin.com/moment/55733776
https://zq.zhaopin.com/moment/55733805
https://zq.zhaopin.com/moment/55733792
https://zq.zhaopin.com/moment/55733762
https://zq.zhaopin.com/moment/55733793
https://zq.zhaopin.com/moment/55733789
https://zq.zhaopin.com/moment/55733715
https://zq.zhaopin.com/moment/55733795
https://zq.zhaopin.com/moment/55733778
https://zq.zhaopin.com/moment/55733692
https://zq.zhaopin.com/moment/55733711
https://zq.zhaopin.com/moment/55733786
https://zq.zhaopin.com/moment/55733717
https://zq.zhaopin.com/moment/55733773
https://zq.zhaopin.com/moment/55733720
https://zq.zhaopin.com/moment/55733798
https://zq.zhaopin.com/moment/55733533
https://zq.zhaopin.com/moment/55733800
https://zq.zhaopin.com/moment/55733894
https://zq.zhaopin.com/moment/55733821
https://zq.zhaopin.com/moment/55733838
https://zq.zhaopin.com/moment/55733976
https://zq.zhaopin.com/moment/55733846
https://zq.zhaopin.com/moment/55733823
https://zq.zhaopin.com/moment/55733867
https://zq.zhaopin.com/moment/55733745
https://zq.zhaopin.com/moment/55733673
https://zq.zhaopin.com/moment/55733826
https://zq.zhaopin.com/moment/55733884
https://zq.zhaopin.com/moment/55733850
https://zq.zhaopin.com/moment/55733841
https://zq.zhaopin.com/moment/55733461
https://zq.zhaopin.com/moment/55733861
https://zq.zhaopin.com/moment/55733817
https://zq.zhaopin.com/moment/55733812
https://zq.zhaopin.com/moment/55733901
https://zq.zhaopin.com/moment/55733864
https://zq.zhaopin.com/moment/55733771
https://zq.zhaopin.com/moment/55733868
https://zq.zhaopin.com/moment/55733871
https://zq.zhaopin.com/moment/55733878
https://zq.zhaopin.com/moment/55733891
https://zq.zhaopin.com/moment/55733910
https://zq.zhaopin.com/moment/55733898
https://zq.zhaopin.com/moment/55733906
https://zq.zhaopin.com/moment/55733900
https://zq.zhaopin.com/moment/55733909
https://zq.zhaopin.com/moment/55733707
https://zq.zhaopin.com/moment/55733602
https://zq.zhaopin.com/moment/55733923
https://zq.zhaopin.com/moment/55733811
https://zq.zhaopin.com/moment/55733949
https://zq.zhaopin.com/moment/55733840
https://zq.zhaopin.com/moment/55733936
https://zq.zhaopin.com/moment/55733931
https://zq.zhaopin.com/moment/55733956
https://zq.zhaopin.com/moment/55733947
https://zq.zhaopin.com/moment/55733919
https://zq.zhaopin.com/moment/55733918
https://zq.zhaopin.com/moment/55733921
https://zq.zhaopin.com/moment/55733942
https://zq.zhaopin.com/moment/55733818
https://zq.zhaopin.com/moment/55733869
https://zq.zhaopin.com/moment/55733985
https://zq.zhaopin.com/moment/55733967
https://zq.zhaopin.com/moment/55733980
https://zq.zhaopin.com/moment/55733991
https://zq.zhaopin.com/moment/55733975
https://zq.zhaopin.com/moment/55733986
https://zq.zhaopin.com/moment/55733989
https://zq.zhaopin.com/moment/55734020
https://zq.zhaopin.com/moment/55733802
https://zq.zhaopin.com/moment/55734009
https://zq.zhaopin.com/moment/55733893
https://zq.zhaopin.com/moment/55734015
https://zq.zhaopin.com/moment/55734010
https://zq.zhaopin.com/moment/55734049
https://zq.zhaopin.com/moment/55734001
https://zq.zhaopin.com/moment/55734028
https://zq.zhaopin.com/moment/55734081
https://zq.zhaopin.com/moment/55734017
https://zq.zhaopin.com/moment/55734142
https://zq.zhaopin.com/moment/55734013
https://zq.zhaopin.com/moment/55733828
https://zq.zhaopin.com/moment/55734029
https://zq.zhaopin.com/moment/55734033
https://zq.zhaopin.com/moment/55734024
https://zq.zhaopin.com/moment/55733997
https://zq.zhaopin.com/moment/55734038
https://zq.zhaopin.com/moment/55734042
https://zq.zhaopin.com/moment/55733925
https://zq.zhaopin.com/moment/55734059
https://zq.zhaopin.com/moment/55734058
https://zq.zhaopin.com/moment/55733934
https://zq.zhaopin.com/moment/55734060
https://zq.zhaopin.com/moment/55734085
https://zq.zhaopin.com/moment/55734012
https://zq.zhaopin.com/moment/55733959
https://zq.zhaopin.com/moment/55734097
https://zq.zhaopin.com/moment/55734077
https://zq.zhaopin.com/moment/55733953
https://zq.zhaopin.com/moment/55734074
https://zq.zhaopin.com/moment/55734122
https://zq.zhaopin.com/moment/55733984
https://zq.zhaopin.com/moment/55733866
https://zq.zhaopin.com/moment/55733987
https://zq.zhaopin.com/moment/55734090
https://zq.zhaopin.com/moment/55734088
https://zq.zhaopin.com/moment/55734106
https://zq.zhaopin.com/moment/55734127
https://zq.zhaopin.com/moment/55734117
https://zq.zhaopin.com/moment/55734132
https://zq.zhaopin.com/moment/55734140
https://zq.zhaopin.com/moment/55734052
https://zq.zhaopin.com/moment/55734047
https://zq.zhaopin.com/moment/55734053
https://zq.zhaopin.com/moment/55734172
https://zq.zhaopin.com/moment/55734153
https://zq.zhaopin.com/moment/55734167
https://zq.zhaopin.com/moment/55734168
https://zq.zhaopin.com/moment/55734270
https://zq.zhaopin.com/moment/55734152
https://zq.zhaopin.com/moment/55734154
https://zq.zhaopin.com/moment/55734145
https://zq.zhaopin.com/moment/55734156
https://zq.zhaopin.com/moment/55734158
https://zq.zhaopin.com/moment/55734057
https://zq.zhaopin.com/moment/55733528
https://zq.zhaopin.com/moment/55734236
https://zq.zhaopin.com/moment/55734144
https://zq.zhaopin.com/moment/55734139
https://zq.zhaopin.com/moment/55734164
https://zq.zhaopin.com/moment/55734208
https://zq.zhaopin.com/moment/55734216
https://zq.zhaopin.com/moment/55734215
https://zq.zhaopin.com/moment/55734218
https://zq.zhaopin.com/moment/55734071
https://zq.zhaopin.com/moment/55734245
https://zq.zhaopin.com/moment/55733962
https://zq.zhaopin.com/moment/55734233
https://zq.zhaopin.com/moment/55734179
https://zq.zhaopin.com/moment/55734219
https://zq.zhaopin.com/moment/55734234
https://zq.zhaopin.com/moment/55734229
https://zq.zhaopin.com/moment/55734177
https://zq.zhaopin.com/moment/55733855
https://zq.zhaopin.com/moment/55734212
https://zq.zhaopin.com/moment/55734181
https://zq.zhaopin.com/moment/55734105
https://zq.zhaopin.com/moment/55734149
https://zq.zhaopin.com/moment/55734197
https://zq.zhaopin.com/moment/55734254
https://zq.zhaopin.com/moment/55734134
https://zq.zhaopin.com/moment/55734255
https://zq.zhaopin.com/moment/55734243
https://zq.zhaopin.com/moment/55734289
https://zq.zhaopin.com/moment/55733897
https://zq.zhaopin.com/moment/55734261
https://zq.zhaopin.com/moment/55734246
https://zq.zhaopin.com/moment/55734239
https://zq.zhaopin.com/moment/55734287
https://zq.zhaopin.com/moment/55734301
https://zq.zhaopin.com/moment/55734159
https://zq.zhaopin.com/moment/55734184
https://zq.zhaopin.com/moment/55734277
https://zq.zhaopin.com/moment/55734054
https://zq.zhaopin.com/moment/55734347
https://zq.zhaopin.com/moment/55734299
https://zq.zhaopin.com/moment/55734339
https://zq.zhaopin.com/moment/55734314
https://zq.zhaopin.com/moment/55734148
https://zq.zhaopin.com/moment/55734209
https://zq.zhaopin.com/moment/55734160
https://zq.zhaopin.com/moment/55734080
https://zq.zhaopin.com/moment/55734297
https://zq.zhaopin.com/moment/55734163
https://zq.zhaopin.com/moment/55734308
https://zq.zhaopin.com/moment/55734313
https://zq.zhaopin.com/moment/55734389
https://zq.zhaopin.com/moment/55734393
https://zq.zhaopin.com/moment/55734221
https://zq.zhaopin.com/moment/55734362
https://zq.zhaopin.com/moment/55734231
https://zq.zhaopin.com/moment/55734380
https://zq.zhaopin.com/moment/55734093
https://zq.zhaopin.com/moment/55734355
https://zq.zhaopin.com/moment/55734369
https://zq.zhaopin.com/moment/55734365
https://zq.zhaopin.com/moment/55734213
https://zq.zhaopin.com/moment/55734100
https://zq.zhaopin.com/moment/55734235
https://zq.zhaopin.com/moment/55734383
https://zq.zhaopin.com/moment/55734199
https://zq.zhaopin.com/moment/55734384
https://zq.zhaopin.com/moment/55734356
https://zq.zhaopin.com/moment/55734360
https://zq.zhaopin.com/moment/55734413
https://zq.zhaopin.com/moment/55734401
https://zq.zhaopin.com/moment/55734260
https://zq.zhaopin.com/moment/55734427
https://zq.zhaopin.com/moment/55734509
https://zq.zhaopin.com/moment/55734425
https://zq.zhaopin.com/moment/55734417
https://zq.zhaopin.com/moment/55733915
https://zq.zhaopin.com/moment/55733961
https://zq.zhaopin.com/moment/55734309
https://zq.zhaopin.com/moment/55734469
https://zq.zhaopin.com/moment/55734285
https://zq.zhaopin.com/moment/55734311
https://zq.zhaopin.com/moment/55734446
https://zq.zhaopin.com/moment/55734438
https://zq.zhaopin.com/moment/55734447
https://zq.zhaopin.com/moment/55734262
https://zq.zhaopin.com/moment/55734445
https://zq.zhaopin.com/moment/55734449
https://zq.zhaopin.com/moment/55734595
https://zq.zhaopin.com/moment/55734399
https://zq.zhaopin.com/moment/55734462
https://zq.zhaopin.com/moment/55734470
https://zq.zhaopin.com/moment/55734491
https://zq.zhaopin.com/moment/55734468
https://zq.zhaopin.com/moment/55734472
https://zq.zhaopin.com/moment/55734473
https://zq.zhaopin.com/moment/55734238
https://zq.zhaopin.com/moment/55734482
https://zq.zhaopin.com/moment/55734521
https://zq.zhaopin.com/moment/55734508
https://zq.zhaopin.com/moment/55734341
https://zq.zhaopin.com/moment/55734500
https://zq.zhaopin.com/moment/55734123
https://zq.zhaopin.com/moment/55734481
https://zq.zhaopin.com/moment/55734511
https://zq.zhaopin.com/moment/55734519
https://zq.zhaopin.com/moment/55734516
https://zq.zhaopin.com/moment/55734526
https://zq.zhaopin.com/moment/55734527
https://zq.zhaopin.com/moment/55734549
https://zq.zhaopin.com/moment/55734531
https://zq.zhaopin.com/moment/55734556
https://zq.zhaopin.com/moment/55734467
https://zq.zhaopin.com/moment/55734555
https://zq.zhaopin.com/moment/55734572
https://zq.zhaopin.com/moment/55734551
https://zq.zhaopin.com/moment/55734579
https://zq.zhaopin.com/moment/55734454
https://zq.zhaopin.com/moment/55734611
https://zq.zhaopin.com/moment/55734596
https://zq.zhaopin.com/moment/55734569
https://zq.zhaopin.com/moment/55734557
https://zq.zhaopin.com/moment/55734497
https://zq.zhaopin.com/moment/55734590
https://zq.zhaopin.com/moment/55734615
https://zq.zhaopin.com/moment/55734605
https://zq.zhaopin.com/moment/55734626
https://zq.zhaopin.com/moment/55734621
https://zq.zhaopin.com/moment/55734363
https://zq.zhaopin.com/moment/55734214
https://zq.zhaopin.com/moment/55734494
https://zq.zhaopin.com/moment/55734627
https://zq.zhaopin.com/moment/55734599
https://zq.zhaopin.com/moment/55734672
https://zq.zhaopin.com/moment/55734641
https://zq.zhaopin.com/moment/55734138
https://zq.zhaopin.com/moment/55734257
https://zq.zhaopin.com/moment/55734264
https://zq.zhaopin.com/moment/55734629
https://zq.zhaopin.com/moment/55734650
https://zq.zhaopin.com/moment/55734663
https://zq.zhaopin.com/moment/55734361
https://zq.zhaopin.com/moment/55734642
https://zq.zhaopin.com/moment/55734251
https://zq.zhaopin.com/moment/55734633
https://zq.zhaopin.com/moment/55734488
https://zq.zhaopin.com/moment/55734628
https://zq.zhaopin.com/moment/55734532
https://zq.zhaopin.com/moment/55734666
https://zq.zhaopin.com/moment/55734708
https://zq.zhaopin.com/moment/55734682
https://zq.zhaopin.com/moment/55734689
https://zq.zhaopin.com/moment/55734714
https://zq.zhaopin.com/moment/55734694
https://zq.zhaopin.com/moment/55734707
https://zq.zhaopin.com/moment/55734173
https://zq.zhaopin.com/moment/55734322
https://zq.zhaopin.com/moment/55734717
https://zq.zhaopin.com/moment/55734702
https://zq.zhaopin.com/moment/55734703
https://zq.zhaopin.com/moment/55734436
https://zq.zhaopin.com/moment/55734723
https://zq.zhaopin.com/moment/55734781
https://zq.zhaopin.com/moment/55734818
https://zq.zhaopin.com/moment/55734464
https://zq.zhaopin.com/moment/55734736
https://zq.zhaopin.com/moment/55734813
https://zq.zhaopin.com/moment/55734581
https://zq.zhaopin.com/moment/55734576
https://zq.zhaopin.com/moment/55734616
https://zq.zhaopin.com/moment/55734592
https://zq.zhaopin.com/moment/55734379
https://zq.zhaopin.com/moment/55734582
https://zq.zhaopin.com/moment/55734622
https://zq.zhaopin.com/moment/55734757
https://zq.zhaopin.com/moment/55734747
https://zq.zhaopin.com/moment/55734624
https://zq.zhaopin.com/moment/55734795
https://zq.zhaopin.com/moment/55734759
https://zq.zhaopin.com/moment/55734368
https://zq.zhaopin.com/moment/55734768
https://zq.zhaopin.com/moment/55734617
https://zq.zhaopin.com/moment/55734782