DS4023编程语言代写、代做Java，Python程序

日期：2021-04-26 11:24

DS4023 Machine Learning

SVM Exercise1

Q1. What linear function is used by a SVM for classification? How is an

input vector ????

(instance) assigned to the positive or negative class?

Q2. If the training examples are linearly separable, how many decision

boundaries can separate positive from negative data points? Which

decision boundary does the SVM algorithm calculate? Why?

Q3. Use Lagrange multiplier method to answer the following questions.

3.1 Consider the Entropy definition:

– If we are given a probability distribution ?? = (??1, ??2, … , ????) ,

then the information conveyed by this distribution, also called the

Entropy of ??, is ??(??) = ?(??1 × log ??1 + ??2 log ??2 + ? +

???? log ????) (The base of the logarithm is 2)

What is the range of entropy of ?? and which distribution gives

maximum entropy? Show the details of your answer.

3.2 Given the probability distribution ?? = (??1, ??2, … , ????), Gini index

is another way to measure the uncertainty ????????(??) = 1 ? ∑ ????

?? 2

??

.

What is the range of Gini index and which distribution gives maximum

Gini index value? Show the details of your answer.

Q4. Given the SVM optimization problem:

min

w,b

1

2

‖w‖

2

??.??. ????

(w??x?? + ??) ≥ 1, ?? = 1,2, … , ??

Derive the dual optimization problem and show the detail steps.

Q5.

for the dual problem, if exist

????

?

that ????

? > 0, then the solution for primal problem is:

Show the detail steps for deriving the solution given ??

?

.