Conversation-Knowledge-Mining-Solution-Accelerator
Posted Updated Agent / Document21 minutes read (About 3081 words)

Conversation-Knowledge-Mining-Solution-Accelerator

대량의 대화 데이터를 보유한 고객이 생성형 AI를 사용하여 주요 구문을 surface(분석)하고 운영 지표와 함께 중요한 Insight를 얻을 수 있도록 하는 솔루션.

아키텍처 그림

  1. 실제 엔터티 추출 : 사람, 제품, 이벤트 장소 또는 행동과 같은 고유한 정보를 처리하고 추출

  2. 채팅 기반 Insight discovery : 모든 인덱싱 된 assets, 단일 assets, 선택한 assets 세트 또는 사용자 주도 키워드 검색을 기반으로 생성된 asset 목록과 채팅 가능

  3. 텍스트 및 문서 데이터 분석 : 문서, 손글씨 텍스트, 차트, 그래프, 표 및 양식 필드를 포함한 다중 모드 문서의 내용을 분석, 비교 및 요약하여 심층적인 통찰력을 제공

  4. 프롬프트 제안 가이드 : 프롬프트 문의를 기반으로 다음 질문 세트를 제안

  5. 다중 모드 정보 처리 : 여러 콘텐츠 유형과 다양한 형식의 지식을 처리하고 추출

대량의 데이터를 신속하게 분석하고, 관련 제안을 생성하여 빠르고 쉽게 추론할 수 있도록 도와준다.

1. Simple Deploy

1-1. roleAssignment 정책상 부여 불가

1
2
3
4
{
  "code": "InvalidTemplateDeployment",
  "message": "The template deployment failed with error: 'Authorization failed for template resource '64f2b582-8f7c-560f-807d-a3f84df8679b' of type 'Microsoft.Authorization/roleAssignments'. The client 'hyejoo.jung@kt.com' with object id '349020e1-be53-4e57-bdb6-40240f0037be' does not have permission to perform action 'Microsoft.Authorization/roleAssignments/write' at scope '/subscriptions/80083cf5-0434-4e94-b9a4-9f8ba244207e/resourceGroups/BC-RA-joo/providers/Microsoft.Authorization/roleAssignments/64f2b582-8f7c-560f-807d-a3f84df8679b'.'."
}
  • Microsoft.Authorization/roleAssignments write 권한 이슈
  • 아래와 같이 roleAssignment 관련 주석 처리
    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    21
    22
    23
    24
    // {
    //   "type": "Microsoft.Authorization/roleAssignments",
    //   "apiVersion": "2022-04-01",
    //   "name": "[guid(resourceGroup().id, resourceId('Microsoft.ManagedIdentity/userAssignedIdentities', parameters('miName')), resourceId('Microsoft.Authorization/roleDefinitions', '8e3af657-a8ff-443c-a75c-2fe8c4bcb635'))]",
    //   "properties": {
    //     "principalId": "[reference(resourceId('Microsoft.ManagedIdentity/userAssignedIdentities', parameters('miName')), '2023-01-31').principalId]",
    //     "roleDefinitionId": "[resourceId('Microsoft.Authorization/roleDefinitions', '8e3af657-a8ff-443c-a75c-2fe8c4bcb635')]",
    //     "principalType": "ServicePrincipal"
    //   },
    //   "dependsOn": [
    //     "[resourceId('Microsoft.ManagedIdentity/userAssignedIdentities', parameters('miName'))]"
    //   ]
    // }
    ...
    // {
    //   "type": "Microsoft.Authorization/roleAssignments",
    //   "apiVersion": "2022-04-01",
    //   "name": "[guid(resourceGroup().id, parameters('managedIdentityObjectId'), resourceId('Microsoft.Authorization/roleDefinitions', '00482a5a-887f-4fb3-b363-3b7fe8e74483'))]",
    //   "properties": {
    //     "principalId": "[parameters('managedIdentityObjectId')]",
    //     "roleDefinitionId": "[resourceId('Microsoft.Authorization/roleDefinitions', '00482a5a-887f-4fb3-b363-3b7fe8e74483')]",
    //     "principalType": "ServicePrincipal"
    //   }
    // },

1-2. OpenAI 모델 지원 이슈

  • sku 변경

    1
    2
    3
    4
    5
    6
    7
    8
    9
    10
    11
    12
    13
    14
    15
    16
    17
    18
    19
    20
    {
      "type": "Microsoft.CognitiveServices/accounts/deployments",
      "apiVersion": "2023-05-01",
      "name": "[format('{0}/{1}', parameters('accounts_ckm_openai_name'), 'gpt-4')]",
      "sku": {
        "name": "GlobalStandard",
        "capacity": 15
    }
    ...
    "sku": {
      "type": "string",
      "defaultValue": "GlobalStandard",
      "allowedValues": [
        "standard",
        "premium"
      ],
      "metadata": {
        "description": "SKU"
      }
    }

  • sku name 필드를 Standard → GlobalStandard로 변경

  • 배포 후 역할 정상 작동하는지 확인 필요

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
resource accounts_ckm_openai_name_gpt_4 'Microsoft.CognitiveServices/accounts/deployments@2023-05-01' = {
  parent: accounts_ckm_openai_name_resource
  name: 'gpt-4o-mini'
  sku: {
    name: 'GlobalStandard'
    capacity: 15
  }
  properties: {
    model: {
      format: 'OpenAI'
      name: 'gpt-4o-mini'
      version: '2024-07-18'
    }
    versionUpgradeOption: 'OnceNewDefaultVersionAvailable'
    raiPolicyName: 'Microsoft.Default'
  }
  //dependsOn:[accounts_ckm_openai_name_resource]
}

{
  "type": "Microsoft.CognitiveServices/accounts/deployments",
  "apiVersion": "2023-05-01",
  "name": "[format('{0}/{1}', parameters('accounts_ckm_openai_name'), 'gpt-4o-mini')]",
  "sku": {
    "name": "GlobalStandard",
    "capacity": 15
  },
  "properties": {
    "model": {
      "format": "OpenAI",
      "name": "gpt-4o-mini",
      "version": "2024-07-18"
    },
    "versionUpgradeOption": "OnceNewDefaultVersionAvailable",
    "raiPolicyName": "Microsoft.Default"
  },
  "dependsOn": [
    "[resourceId('Microsoft.CognitiveServices/accounts', parameters('accounts_ckm_openai_name'))]"
  ]
}

최종 템플릿

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
{
  "$schema": "https://schema.management.azure.com/schemas/2019-04-01/deploymentTemplate.json#",
  "contentVersion": "1.0.0.0",
  "metadata": {
    "_generator": {
      "name": "bicep",
      "version": "0.28.1.47646",
      "templateHash": "8858477527853866674"
    }
  },
  "parameters": {
    "solutionPrefix": {
      "type": "string",
      "minLength": 3,
      "maxLength": 6,
      "metadata": {
        "description": "Prefix Name"
      }
    },
    "location": {
      "type": "string",
      "defaultValue": "[resourceGroup().location]"
    }
  },
  "variables": {
    "resourceGroupLocation": "[parameters('location')]",
    "solutionLocation": "[variables('resourceGroupLocation')]"
  },
  "resources": [
    {
      "type": "Microsoft.Resources/deployments",
      "apiVersion": "2022-09-01",
      "name": "deploy_managed_identity",
      "resourceGroup": "[resourceGroup().name]",
      "properties": {
        "expressionEvaluationOptions": {
          "scope": "inner"
        },
        "mode": "Incremental",
        "parameters": {
          "solutionName": {
            "value": "[parameters('solutionPrefix')]"
          },
          "solutionLocation": {
            "value": "[variables('solutionLocation')]"
          }
        },
        "template": {
          "$schema": "https://schema.management.azure.com/schemas/2019-04-01/deploymentTemplate.json#",
          "contentVersion": "1.0.0.0",
          "metadata": {
            "_generator": {
              "name": "bicep",
              "version": "0.28.1.47646",
              "templateHash": "14133192615685065374"
            }
          },
          "parameters": {
            "solutionName": {
              "type": "string",
              "minLength": 3,
              "maxLength": 15,
              "metadata": {
                "description": "Solution Name"
              }
            },
            "solutionLocation": {
              "type": "string",
              "metadata": {
                "description": "Solution Location"
              }
            },
            "miName": {
              "type": "string",
              "defaultValue": "[format('{0}-managed-identity', parameters('solutionName'))]",
              "metadata": {
                "description": "Name"
              }
            }
          },
          "resources": [
            {
              "type": "Microsoft.ManagedIdentity/userAssignedIdentities",
              "apiVersion": "2023-01-31",
              "name": "[parameters('miName')]",
              "location": "[parameters('solutionLocation')]",
              "tags": {
                "app": "[parameters('solutionName')]",
                "location": "[parameters('solutionLocation')]"
              }
            }
            // {
            //   "type": "Microsoft.Authorization/roleAssignments",
            //   "apiVersion": "2022-04-01",
            //   "name": "[guid(resourceGroup().id, resourceId('Microsoft.ManagedIdentity/userAssignedIdentities', parameters('miName')), resourceId('Microsoft.Authorization/roleDefinitions', '8e3af657-a8ff-443c-a75c-2fe8c4bcb635'))]",
            //   "properties": {
            //     "principalId": "[reference(resourceId('Microsoft.ManagedIdentity/userAssignedIdentities', parameters('miName')), '2023-01-31').principalId]",
            //     "roleDefinitionId": "[resourceId('Microsoft.Authorization/roleDefinitions', '8e3af657-a8ff-443c-a75c-2fe8c4bcb635')]",
            //     "principalType": "ServicePrincipal"
            //   },
            //   "dependsOn": [
            //     "[resourceId('Microsoft.ManagedIdentity/userAssignedIdentities', parameters('miName'))]"
            //   ]
            // }
          ],
          "outputs": {
            "managedIdentityOutput": {
              "type": "object",
              "value": {
                "id": "[resourceId('Microsoft.ManagedIdentity/userAssignedIdentities', parameters('miName'))]",
                "objectId": "[reference(resourceId('Microsoft.ManagedIdentity/userAssignedIdentities', parameters('miName')), '2023-01-31').principalId]",
                "name": "[parameters('miName')]"
              }
            }
          }
        }
      }
    },
    {
      "type": "Microsoft.Resources/deployments",
      "apiVersion": "2022-09-01",
      "name": "deploy_azure_ai_service",
      "properties": {
        "expressionEvaluationOptions": {
          "scope": "inner"
        },
        "mode": "Incremental",
        "parameters": {
          "solutionName": {
            "value": "[parameters('solutionPrefix')]"
          },
          "solutionLocation": {
            "value": "[variables('solutionLocation')]"
          }
        },
        "template": {
          "$schema": "https://schema.management.azure.com/schemas/2019-04-01/deploymentTemplate.json#",
          "contentVersion": "1.0.0.0",
          "metadata": {
            "_generator": {
              "name": "bicep",
              "version": "0.28.1.47646",
              "templateHash": "8537007800307151650"
            }
          },
          "parameters": {
            "solutionName": {
              "type": "string",
              "minLength": 3,
              "maxLength": 15,
              "metadata": {
                "description": "Solution Name"
              }
            },
            "solutionLocation": {
              "type": "string"
            },
            "accounts_byc_cogser_name": {
              "type": "string",
              "defaultValue": "[format('{0}-cogser', parameters('solutionName'))]"
            }
          },
          "resources": [
            {
              "type": "Microsoft.CognitiveServices/accounts",
              "apiVersion": "2023-05-01",
              "name": "[parameters('accounts_byc_cogser_name')]",
              "location": "[parameters('solutionLocation')]",
              "sku": {
                "name": "S0"
              },
              "kind": "CognitiveServices",
              "identity": {
                "type": "None"
              },
              "properties": {
                "apiProperties": {},
                "customSubDomainName": "[parameters('accounts_byc_cogser_name')]",
                "networkAcls": {
                  "defaultAction": "Allow",
                  "virtualNetworkRules": [],
                  "ipRules": []
                },
                "publicNetworkAccess": "Enabled"
              }
            }
          ],
          "outputs": {
            "cogSearchOutput": {
              "type": "object",
              "value": {
                "cogServiceName": "[parameters('accounts_byc_cogser_name')]",
                "cogServiceKey": "[listKeys(resourceId('Microsoft.CognitiveServices/accounts', parameters('accounts_byc_cogser_name')), '2023-05-01').key1]",
                "cogServiceEndpoint": "[reference(resourceId('Microsoft.CognitiveServices/accounts', parameters('accounts_byc_cogser_name')), '2023-05-01').endpoint]",
                "cogServiceRegion": "[reference(resourceId('Microsoft.CognitiveServices/accounts', parameters('accounts_byc_cogser_name')), '2023-05-01', 'full').location]"
              }
            }
          }
        }
      }
    },
    {
      "type": "Microsoft.Resources/deployments",
      "apiVersion": "2022-09-01",
      "name": "deploy_azure_open_ai",
      "properties": {
        "expressionEvaluationOptions": {
          "scope": "inner"
        },
        "mode": "Incremental",
        "parameters": {
          "solutionName": {
            "value": "[parameters('solutionPrefix')]"
          },
          "solutionLocation": {
            "value": "[variables('solutionLocation')]"
          }
        },
        "template": {
          "$schema": "https://schema.management.azure.com/schemas/2019-04-01/deploymentTemplate.json#",
          "contentVersion": "1.0.0.0",
          "metadata": {
            "_generator": {
              "name": "bicep",
              "version": "0.28.1.47646",
              "templateHash": "16531009550718652696"
            }
          },
          "parameters": {
            "solutionName": {
              "type": "string",
              "minLength": 3,
              "maxLength": 15,
              "metadata": {
                "description": "Solution Name"
              }
            },
            "solutionLocation": {
              "type": "string"
            },
            "accounts_ckm_openai_name": {
              "type": "string",
              "defaultValue": "[format('{0}-openai', parameters('solutionName'))]"
            }
          },
          "resources": [
            {
              "type": "Microsoft.CognitiveServices/accounts",
              "apiVersion": "2023-05-01",
              "name": "[parameters('accounts_ckm_openai_name')]",
              "location": "[parameters('solutionLocation')]",
              "sku": {
                "name": "S0"
              },
              "kind": "OpenAI",
              "properties": {
                "customSubDomainName": "[parameters('accounts_ckm_openai_name')]",
                "networkAcls": {
                  "defaultAction": "Allow",
                  "virtualNetworkRules": [],
                  "ipRules": []
                },
                "publicNetworkAccess": "Enabled"
              }
            },
            {
              "type": "Microsoft.CognitiveServices/accounts/deployments",
              "apiVersion": "2023-05-01",
              "name": "[format('{0}/{1}', parameters('accounts_ckm_openai_name'), 'gpt-4o-mini')]",
              "sku": {
                "name": "GlobalStandard",
                "capacity": 15
              },
              "properties": {
                "model": {
                  "format": "OpenAI",
                  "name": "gpt-4o-mini",
                  "version": "2024-07-18"
                },
                "versionUpgradeOption": "OnceNewDefaultVersionAvailable",
                "raiPolicyName": "Microsoft.Default"
              },
              "dependsOn": [
                "[resourceId('Microsoft.CognitiveServices/accounts', parameters('accounts_ckm_openai_name'))]"
              ]
            }
          ],
          "outputs": {
            "openAIOutput": {
              "type": "object",
              "value": {
                "openAPIKey": "[listKeys(resourceId('Microsoft.CognitiveServices/accounts', parameters('accounts_ckm_openai_name')), '2023-05-01').key1]",
                "openAPIVersion": "2023-05-01",
                "openAPIEndpoint": "[reference(resourceId('Microsoft.CognitiveServices/accounts', parameters('accounts_ckm_openai_name')), '2023-05-01').endpoint]",
                "openAIAccountName": "[parameters('accounts_ckm_openai_name')]"
              }
            }
          }
        }
      }
    },
    {
      "type": "Microsoft.Resources/deployments",
      "apiVersion": "2022-09-01",
      "name": "deploy_keyvault",
      "resourceGroup": "[resourceGroup().name]",
      "properties": {
        "expressionEvaluationOptions": {
          "scope": "inner"
        },
        "mode": "Incremental",
        "parameters": {
          "solutionName": {
            "value": "[parameters('solutionPrefix')]"
          },
          "solutionLocation": {
            "value": "[variables('solutionLocation')]"
          },
          "objectId": {
            "value": "[reference(extensionResourceId(format('/subscriptions/{0}/resourceGroups/{1}', subscription().subscriptionId, resourceGroup().name), 'Microsoft.Resources/deployments', 'deploy_managed_identity'), '2022-09-01').outputs.managedIdentityOutput.value.objectId]"
          },
          "tenantId": {
            "value": "[subscription().tenantId]"
          },
          "managedIdentityObjectId": {
            "value": "[reference(extensionResourceId(format('/subscriptions/{0}/resourceGroups/{1}', subscription().subscriptionId, resourceGroup().name), 'Microsoft.Resources/deployments', 'deploy_managed_identity'), '2022-09-01').outputs.managedIdentityOutput.value.objectId]"
          },
          "azureOpenAIApiKey": {
            "value": "[reference(resourceId('Microsoft.Resources/deployments', 'deploy_azure_open_ai'), '2022-09-01').outputs.openAIOutput.value.openAPIKey]"
          },
          "azureOpenAIApiVersion": {
            "value": "2023-07-01-preview"
          },
          "azureOpenAIEndpoint": {
            "value": "[reference(resourceId('Microsoft.Resources/deployments', 'deploy_azure_open_ai'), '2022-09-01').outputs.openAIOutput.value.openAPIEndpoint]"
          },
          "cogServiceEndpoint": {
            "value": "[reference(resourceId('Microsoft.Resources/deployments', 'deploy_azure_ai_service'), '2022-09-01').outputs.cogSearchOutput.value.cogServiceEndpoint]"
          },
          "cogServiceName": {
            "value": "[reference(resourceId('Microsoft.Resources/deployments', 'deploy_azure_ai_service'), '2022-09-01').outputs.cogSearchOutput.value.cogServiceName]"
          },
          "cogServiceKey": {
            "value": "[reference(resourceId('Microsoft.Resources/deployments', 'deploy_azure_ai_service'), '2022-09-01').outputs.cogSearchOutput.value.cogServiceKey]"
          },
          "cogServiceRegion": {
            "value": "[reference(resourceId('Microsoft.Resources/deployments', 'deploy_azure_ai_service'), '2022-09-01').outputs.cogSearchOutput.value.cogServiceRegion]"
          },
          "enableSoftDelete": {
            "value": false
          }
        },
        "template": {
          "$schema": "https://schema.management.azure.com/schemas/2019-04-01/deploymentTemplate.json#",
          "contentVersion": "1.0.0.0",
          "metadata": {
            "_generator": {
              "name": "bicep",
              "version": "0.28.1.47646",
              "templateHash": "12149961923112846409"
            }
          },
          "parameters": {
            "solutionName": {
              "type": "string",
              "minLength": 3,
              "maxLength": 15,
              "metadata": {
                "description": "Solution Name"
              }
            },
            "solutionLocation": {
              "type": "string",
              "metadata": {
                "description": "Solution Location"
              }
            },
            "utc": {
              "type": "string",
              "defaultValue": "[utcNow()]"
            },
            "kvName": {
              "type": "string",
              "defaultValue": "[format('{0}-kv-{1}', parameters('solutionName'), uniqueString(parameters('utc')))]",
              "metadata": {
                "description": "Name"
              }
            },
            "objectId": {
              "type": "string",
              "metadata": {
                "description": "Object Id. The object ID of a user, service principal or security group in the Azure Active Directory tenant for the vault."
              }
            },
            "createMode": {
              "type": "string",
              "defaultValue": "default",
              "metadata": {
                "description": "Create Mode"
              }
            },
            "enableForDeployment": {
              "type": "bool",
              "defaultValue": true,
              "metadata": {
                "description": "Enabled For Deployment. Property to specify whether Azure Virtual Machines are permitted to retrieve certificates stored as secrets from the key vault."
              }
            },
            "enableForDiskEncryption": {
              "type": "bool",
              "defaultValue": true,
              "metadata": {
                "description": "Enabled For Disk Encryption. Property to specify whether Azure Disk Encryption is permitted to retrieve secrets from the vault and unwrap keys."
              }
            },
            "enableForTemplateDeployment": {
              "type": "bool",
              "defaultValue": true,
              "metadata": {
                "description": "Enabled For Template Deployment. Property to specify whether Azure Resource Manager is permitted to retrieve secrets from the key vault."
              }
            },
            "enablePurgeProtection": {
              "type": "bool",
              "defaultValue": true,
              "metadata": {
                "description": "Enable Purge Protection. Property specifying whether protection against purge is enabled for this vault."
              }
            },
            "enableRBACAuthorization": {
              "type": "bool",
              "defaultValue": true,
              "metadata": {
                "description": "Enable RBAC Authorization. Property that controls how data actions are authorized."
              }
            },
            "enableSoftDelete": {
              "type": "bool",
              "defaultValue": false,
              "metadata": {
                "description": "Enable Soft Delete. Property to specify whether the \"soft delete\" functionality is enabled for this key vault."
              }
            },
            "softDeleteRetentionInDays": {
              "type": "int",
              "defaultValue": 30,
              "metadata": {
                "description": "Soft Delete Retention in Days. softDelete data retention days. It accepts >=7 and <=90."
              }
            },
            "publicNetworkAccess": {
              "type": "string",
              "defaultValue": "enabled",
              "allowedValues": [
                "enabled",
                "disabled"
              ],
              "metadata": {
                "description": "Public Network Access, Property to specify whether the vault will accept traffic from public internet."
              }
            },
            "sku": {
              "type": "string",
              "defaultValue": "GlobalStandard",
              "allowedValues": [
                "standard",
                "premium"
              ],
              "metadata": {
                "description": "SKU"
              }
            },
            "tenantId": {
              "type": "string",
              "metadata": {
                "description": "Tenant Id"
              }
            },
            "managedIdentityObjectId": {
              "type": "string"
            },
            "azureOpenAIApiKey": {
              "type": "securestring"
            },
            "azureOpenAIApiVersion": {
              "type": "string"
            },
            "azureOpenAIEndpoint": {
              "type": "string"
            },
            "cogServiceEndpoint": {
              "type": "string"
            },
            "cogServiceKey": {
              "type": "securestring"
            },
            "cogServiceName": {
              "type": "string"
            },
            "cogServiceRegion": {
              "type": "string"
            }
          },
          "variables": {
            "vaultUri": "[format('https://{0}.vault.azure.net/', parameters('kvName'))]"
          },
          "resources": [
            {
              "type": "Microsoft.KeyVault/vaults",
              "apiVersion": "2022-07-01",
              "name": "[parameters('kvName')]",
              "location": "[parameters('solutionLocation')]",
              "tags": {
                "app": "[parameters('solutionName')]",
                "location": "[parameters('solutionLocation')]"
              },
              "properties": {
                "accessPolicies": [
                  {
                    "objectId": "[parameters('objectId')]",
                    "permissions": {
                      "certificates": [
                        "all"
                      ],
                      "keys": [
                        "all"
                      ],
                      "secrets": [
                        "all"
                      ],
                      "storage": [
                        "all"
                      ]
                    },
                    "tenantId": "[parameters('tenantId')]"
                  }
                ],
                "createMode": "[parameters('createMode')]",
                "enabledForDeployment": "[parameters('enableForDeployment')]",
                "enabledForDiskEncryption": "[parameters('enableForDiskEncryption')]",
                "enabledForTemplateDeployment": "[parameters('enableForTemplateDeployment')]",
                "enablePurgeProtection": "[parameters('enablePurgeProtection')]",
                "enableRbacAuthorization": "[parameters('enableRBACAuthorization')]",
                "enableSoftDelete": "[parameters('enableSoftDelete')]",
                "softDeleteRetentionInDays": "[parameters('softDeleteRetentionInDays')]",
                "provisioningState": "RegisteringDns",
                "publicNetworkAccess": "[parameters('publicNetworkAccess')]",
                "sku": {
                  "family": "A",
                  "name": "[parameters('sku')]"
                },
                "tenantId": "[parameters('tenantId')]",
                "vaultUri": "[variables('vaultUri')]"
              }
            },
            // {
            //   "type": "Microsoft.Authorization/roleAssignments",
            //   "apiVersion": "2022-04-01",
            //   "name": "[guid(resourceGroup().id, parameters('managedIdentityObjectId'), resourceId('Microsoft.Authorization/roleDefinitions', '00482a5a-887f-4fb3-b363-3b7fe8e74483'))]",
            //   "properties": {
            //     "principalId": "[parameters('managedIdentityObjectId')]",
            //     "roleDefinitionId": "[resourceId('Microsoft.Authorization/roleDefinitions', '00482a5a-887f-4fb3-b363-3b7fe8e74483')]",
            //     "principalType": "ServicePrincipal"
            //   }
            // },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'TENANT-ID')]",
              "properties": {
                "value": "[parameters('tenantId')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'AZURE-OPENAI-KEY')]",
              "properties": {
                "value": "[parameters('azureOpenAIApiKey')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'AZURE-OPENAI-VERSION')]",
              "properties": {
                "value": "[parameters('azureOpenAIApiVersion')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'AZURE-OPENAI-ENDPOINT')]",
              "properties": {
                "value": "[parameters('azureOpenAIEndpoint')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'COG-SERVICES-ENDPOINT')]",
              "properties": {
                "value": "[parameters('cogServiceEndpoint')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'COG-SERVICES-KEY')]",
              "properties": {
                "value": "[parameters('cogServiceKey')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'COG-SERVICES-NAME')]",
              "properties": {
                "value": "[parameters('cogServiceName')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'COG-SERVICES-REGION')]",
              "properties": {
                "value": "[parameters('cogServiceRegion')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'AZURE-SUBSCRIPTION-ID')]",
              "properties": {
                "value": "[subscription().subscriptionId]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'AZURE-RESOURCE-GROUP')]",
              "properties": {
                "value": "[resourceGroup().name]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            },
            {
              "type": "Microsoft.KeyVault/vaults/secrets",
              "apiVersion": "2021-11-01-preview",
              "name": "[format('{0}/{1}', parameters('kvName'), 'AZURE-LOCATION')]",
              "properties": {
                "value": "[parameters('solutionLocation')]"
              },
              "dependsOn": [
                "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]"
              ]
            }
          ],
          "outputs": {
            "keyvaultOutput": {
              "type": "object",
              "value": {
                "id": "[resourceId('Microsoft.KeyVault/vaults', parameters('kvName'))]",
                "name": "[parameters('kvName')]",
                "uri": "[variables('vaultUri')]",
                "resource": "[reference(resourceId('Microsoft.KeyVault/vaults', parameters('kvName')), '2022-07-01', 'full')]"
              }
            }
          }
        }
      },
      "dependsOn": [
        "[resourceId('Microsoft.Resources/deployments', 'deploy_azure_ai_service')]",
        "[resourceId('Microsoft.Resources/deployments', 'deploy_azure_open_ai')]",
        "[extensionResourceId(format('/subscriptions/{0}/resourceGroups/{1}', subscription().subscriptionId, resourceGroup().name), 'Microsoft.Resources/deployments', 'deploy_managed_identity')]"
      ]
    }
  ]
}
  • 리소스 그룹 : rg-ckm-1219-v0
  • Region : Korea Central
  • Solution Prefix : ConKM

배포 실패

에러 내용

1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
{
  "code": "DeploymentFailed",
  "target": "/subscriptions/80083cf5-0434-4e94-b9a4-9f8ba244207e/resourceGroups/rg-ckm-1219-v0/providers/Microsoft.Resources/deployments/Microsoft.Template-20241219202047",
  "message": "At least one resource deployment operation failed. Please list deployment operations for details. Please see https://aka.ms/arm-deployment-operations for usage details.",
  "details": [
    {
      "code": "InvalidTemplate",
      "message": "Deployment template validation failed: 'The provided value for the template parameter 'sku' is not valid. The value 'GlobalStandard' is not part of the allowed value(s): 'standard,premium'.'.",
      "additionalInfo": [
        {
          "type": "TemplateViolation",
          "info": {
            "lineNumber": 1,
            "linePosition": 3520,
            "path": "properties.template.parameters.sku.allowedValues"
          }
        }
      ]
    }
  ]
}
  • sku 파라미터의 값이 유요하지 않다고 한다
  • GlobalStandard가 아니라 standard, premium만 사용 가능하다고 한다.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
{
    "type": "Microsoft.CognitiveServices/accounts/deployments",
    "apiVersion": "2023-05-01",
    "name": "[format('{0}/{1}', parameters('accounts_ckm_openai_name'), 'gpt-4o-mini')]",
    "sku": {
        "name": "GlobalStandard",
        "capacity": 15
    },
    "properties": {
        "model": {
            "format": "OpenAI",
            "name": "gpt-4o-mini",
            "version": "2024-07-18"
        },
        "versionUpgradeOption": "OnceNewDefaultVersionAvailable",
        "raiPolicyName": "Microsoft.Default"
    },
    "dependsOn": [
        "[resourceId('Microsoft.CognitiveServices/accounts', parameters('accounts_ckm_openai_name'))]"
    ]
}
...
"sku": {
    "type": "string",
    "defaultValue": "standard",
    "allowedValues": [
        "standard",
        "premium"
    ],
    "metadata": {
        "description": "SKU"
    }
},
  • 다시 위와 같이 수정

다시 배포 해보니

배포가 성공적으로 마무리 되었다.

리소스는 위와 같이 나타난다.

2. Fabric workspace 생성

  • Fabric Workspace로 이동한다.
  • 왼쪽 내비게이션에서 + 워크스페이스 버튼을 클릭하여 워크스페이스를 생성한다.
  • URL에서 Workspace ID를 확인한다.

워크스페이스 ID 확인 방법

Fabric 사이트에서 워크스페이스의 항목 URL을 통해 가장 쉽게 워크스페이스 ID를 찾을 수 있다. Power BI와 마찬가지로, Fabric URL에는 워크스페이스 ID가 포함되어 있으며, 이는 URL에서 /groups/ 다음에 나오는 고유 식별자이다.
예를 들어:
https://powerbi.com/groups/11aa111-a11a-1111-1abc-aa1111aaaa/…

또는, Power BI 관리자 포털의 설정에서 워크스페이스 이름 옆에 있는 **세부정보(Details)**를 선택하여 워크스페이스 ID를 확인할 수도 있다.

3. Fabric 리소스 및 아티팩트 배포

  1. Azure Portal로 이동
  • Azure Portal에 접속.
  1. Azure Cloud Shell 열기
  • 내비게이션 메뉴의 오른쪽 상단에서 Azure Cloud Shell을 클릭

  1. 다음 명령 실행
  • 아래 명령어를 Azure Cloud Shell에서 실행한다.
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
az login ***Azure Cloud Shell의 로그인 지침을 따라 로그인을 완료.

rm -rf ./Customer-Service-Conversational-Insights-with-Azure-OpenAI-Services

git clone https://github.com/microsoft/Customer-Service-Conversational-Insights-with-Azure-OpenAI-Services

cd ./Customer-Service-Conversational-Insights-with-Azure-OpenAI-Services/Deployment/scripts/fabric_scripts

sh ./run_fabric_items_scripts.sh keyvault_param workspaceid_param solutionprefix_param
- keyvault_param: 1단계에서 생성한 Key Vault의 이름 ConKM-kv-pm7k3nx4pijba
    - 키볼트 확인하기
    az keyvault list --resource-group <Resource-Group-Name> --query "[].{Name:name}" -o table
- workspaceid_param: 2단계에서 생성한 Workspace ID bfccf397-49f8-4822-a23e-19b0187256c7
- solutionprefix_param: Lakehouse 생성 시 추가되는 접두사 conkm

sh ./run_fabric_items_scripts.sh ConKM-kv-pm7k3nx4pijba bfccf397-49f8-4822-a23e-19b0187256c7 conkm

Lakehouse 만들기

Fabric 구독

하지만…

  1. Fabric Lakehouse 연결 세부 정보 가져오기
  2. 배포가 완료되면 Fabric Workspace로 이동
  3. 워크스페이스에서 Lakehouse를 찾는다. (예: lakehouse_solutionprefix_param)
  4. Lakehouse 이름 옆의 …을 클릭.
  5. SQL Analytics Endpoint를 선택.
  6. 팝업 창에서 SQL 연결 문자열 복사(Copy SQL connection string) 버튼을 클릭.
  7. 데이터 파이프라인 처리 완료 대기

데이터 파이프라인 처리가 완료될 때까지 10~15분 정도 기다린 후 다음 단계로 진행.

Conversation-Knowledge-Mining-Solution-Accelerator

https://hamin7.github.io/2024/12/19/Conversation-Knowledge-Mining-Solution-Accelerator/

Author

hamin

Posted on

2024-12-19

Updated on

2024-12-21

Licensed under

#
You need to set install_url to use ShareThis. Please set it in _config.yml.

Like this article? Support the author with

You forgot to set the business or currency_code for Paypal. Please set it in _config.yml.

Comments

You forgot to set the shortname for Disqus. Please set it in _config.yml.
Follow

Links

Categories

Recents

Archives

Tags

AI6
AWS19
AZ1041
AZ2041
Agent2
Akka1
Algorithm4
Azure9
BERT1
Backend4
Batch Server1
Blog1
Books1
CLI1
CS2
Cassandra1
Cloud1
Concurrency1
Container2
Crawling1
Cron1
DataStructure2
Database1
Deep Learning1
DeepLearning6
DevOps5
Distributed Systems2
Django1
Docker7
Firebase1
Frontend1
GPU1
Hexo1
Hololens1
Insertion Sort1
Java4
Javascript1
JupyterLab1
Kafka1
Kruscal1
Kubernetes3
LLM5
LLM,LangChain1
LaTeX1
Lagom2
LangChain5
LangSmith1
Linux1
LiteLLM1
MS Azure6
MST1
Machine Learning2
MachineLearning4
Matplotlib1
Microservices1
Microsoft8
Microsoft,Azure6
Multi-threading1
NLP2
Netflix1
Network3
Node.js2
Pandas1
Prim1
Programming1
Python3
Quick Sort1
React1
React.js1
Redis1
Redux1
SK1
SageMaker1
Scala1
Scalability1
Security4
Selection Sort1
Sort3
Travel2
UnionFind1
Unix1
Usenix1
Zookeeper1
blockchain1
c#1
graphql5
javascript2
machineLearning1
maya1
nmap2
node.js5
prisma5
python1
typescript5
unity1
vuforia1

Subscribe for updates

You need to set client_id and slot_id to show this AD unit. Please set it in _config.yml.

follow.it

×