#### 联系方式

• QQ：99515681
• 邮箱：99515681@qq.com
• 工作时间：8:00-23:00
• 微信：codinghelp

#### 您当前位置：首页 >> Java编程Java编程

###### 日期：2021-04-26 11:24

DS4023 Machine Learning

SVM Exercise1

Q1. What linear function is used by a SVM for classification? How is an

input vector ????

(instance) assigned to the positive or negative class?

Q2. If the training examples are linearly separable, how many decision

boundaries can separate positive from negative data points? Which

decision boundary does the SVM algorithm calculate? Why?

Q3. Use Lagrange multiplier method to answer the following questions.

3.1 Consider the Entropy definition:

– If we are given a probability distribution ?? = (??1, ??2, … , ????) ,

then the information conveyed by this distribution, also called the

Entropy of ??, is ??(??) = ?(??1 × log ??1 + ??2 log ??2 + ? +

???? log ????) (The base of the logarithm is 2)

What is the range of entropy of ?? and which distribution gives

3.2 Given the probability distribution ?? = (??1, ??2, … , ????), Gini index

is another way to measure the uncertainty ????????(??) = 1 ? ∑ ????

?? 2

??

.

What is the range of Gini index and which distribution gives maximum

Q4. Given the SVM optimization problem:

min

w,b

1

2

‖w‖

2

??.??. ????

(w??x?? + ??) ≥ 1, ?? = 1,2, … , ??

Derive the dual optimization problem and show the detail steps.

Q5.

for the dual problem, if exist

????

?

that ????

? > 0, then the solution for primal problem is:

Show the detail steps for deriving the solution given ??

?

.