Calculus Examples

$J_{j (θ)} = - y^{(j)} \log (σ) (x^{(j)} \cdot θ) - (1 - y^{(j)}) \log (1 - σ (x^{(j)} \cdot θ))$

Step 1

By the Sum Rule, the derivative of $- y^{j} \log (σ) (x^{(j)} \cdot θ) - (1 - y^{j}) \log (1 - σ (x^{(j)} \cdot θ))$ with respect to $x$ is $\frac{d}{d x} [- y^{j} \log (σ) (x^{(j)} \cdot θ)] + \frac{d}{d x} [- (1 - y^{j}) \log (1 - σ (x^{(j)} \cdot θ))]$ .

$\frac{d}{d x} [- y^{j} \log (σ) (x^{(j)} \cdot θ)] + \frac{d}{d x} [- (1 - y^{j}) \log (1 - σ (x^{(j)} \cdot θ))]$

Step 2

Evaluate $\frac{d}{d x} [- y^{j} \log (σ) (x^{(j)} \cdot θ)]$ .

Tap for more steps...

Step 2.1

Since $- y^{j} \log (σ) θ$ is constant with respect to $x$ , the derivative of $- y^{j} \log (σ) (x^{j} θ)$ with respect to $x$ is $- y^{j} \log (σ) θ \frac{d}{d x} [x^{j}]$ .

$- y^{j} \log (σ) θ \frac{d}{d x} [x^{j}] + \frac{d}{d x} [- (1 - y^{j}) \log (1 - σ (x^{(j)} \cdot θ))]$

Step 2.2

Differentiate using the Power Rule which states that $\frac{d}{d x} [x^{n}]$ is $n x^{n - 1}$ where $n = j$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) + \frac{d}{d x} [- (1 - y^{j}) \log (1 - σ (x^{(j)} \cdot θ))]$

Step 3

Evaluate $\frac{d}{d x} [- (1 - y^{j}) \log (1 - σ (x^{(j)} \cdot θ))]$ .

Tap for more steps...

Step 3.1

Since $- (1 - y^{j})$ is constant with respect to $x$ , the derivative of $- (1 - y^{j}) \log (1 - σ x^{j} θ)$ with respect to $x$ is $- (1 - y^{j}) \frac{d}{d x} [\log (1 - σ x^{j} θ)]$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) \frac{d}{d x} [\log (1 - σ x^{j} θ)]$

Step 3.2

Differentiate using the chain rule, which states that $\frac{d}{d x} [f (g (x))]$ is $f' (g (x)) g' (x)$ where $f (x) = \log (x)$ and $g (x) = 1 - σ x^{j} θ$ .

Tap for more steps...

Step 3.2.1

To apply the Chain Rule, set $u$ as $1 - σ x^{j} θ$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (\frac{d}{d u} [\log (u)] \frac{d}{d x} [1 - σ x^{j} θ])$

Step 3.2.2

The derivative of $\log (u)$ with respect to $u$ is $\frac{1}{u \ln (10)}$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (\frac{1}{(1 - σ x^{j} θ) \ln (10)} \frac{d}{d x} [1 - σ x^{j} θ])$

Step 3.3

By the Sum Rule, the derivative of $1 - σ x^{j} θ$ with respect to $x$ is $\frac{d}{d x} [1] + \frac{d}{d x} [- σ x^{j} θ]$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (\frac{1}{(1 - σ x^{j} θ) \ln (10)} (\frac{d}{d x} [1] + \frac{d}{d x} [- σ x^{j} θ]))$

Step 3.4

Since $1$ is constant with respect to $x$ , the derivative of $1$ with respect to $x$ is $0$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (\frac{1}{(1 - σ x^{j} θ) \ln (10)} (0 + \frac{d}{d x} [- σ x^{j} θ]))$

Step 3.5

Since $- σ θ$ is constant with respect to $x$ , the derivative of $- σ x^{j} θ$ with respect to $x$ is $- σ θ \frac{d}{d x} [x^{j}]$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (\frac{1}{(1 - σ x^{j} θ) \ln (10)} (0 - σ θ \frac{d}{d x} [x^{j}]))$

Step 3.6

Differentiate using the Power Rule which states that $\frac{d}{d x} [x^{n}]$ is $n x^{n - 1}$ where $n = j$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (\frac{1}{(1 - σ x^{j} θ) \ln (10)} (0 - σ θ (j x^{j - 1})))$

Step 3.7

Subtract $σ θ j x^{j - 1}$ from $0$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (\frac{1}{(1 - σ x^{j} θ) \ln (10)} (- σ θ j x^{j - 1}))$

Step 3.8

Combine $\frac{1}{(1 - σ x^{j} θ) \ln (10)}$ and $σ$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (- \frac{σ}{(1 - σ x^{j} θ) \ln (10)} θ j x^{j - 1})$

Step 3.9

Combine $θ$ and $\frac{σ}{(1 - σ x^{j} θ) \ln (10)}$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (- \frac{θ σ}{(1 - σ x^{j} θ) \ln (10)} j x^{j - 1})$

Step 3.10

Combine $j$ and $\frac{θ σ}{(1 - σ x^{j} θ) \ln (10)}$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (- \frac{j (θ σ)}{(1 - σ x^{j} θ) \ln (10)} x^{j - 1})$

Step 3.11

Combine $x^{j - 1}$ and $\frac{j (θ σ)}{(1 - σ x^{j} θ) \ln (10)}$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) - (1 - y^{j}) (- \frac{x^{j - 1} (j (θ σ))}{(1 - σ x^{j} θ) \ln (10)})$

Step 3.12

Multiply $- 1$ by $- 1$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) + 1 (1 - y^{j}) \frac{x^{j - 1} (j θ σ)}{(1 - σ x^{j} θ) \ln (10)}$

Step 3.13

Multiply $1 - y^{j}$ by $1$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) + (1 - y^{j}) \frac{x^{j - 1} (j θ σ)}{(1 - σ x^{j} θ) \ln (10)}$

Step 4

Simplify.

Tap for more steps...

Step 4.1

Apply the distributive property.

$- y^{j} \log (σ) θ (j x^{j - 1}) + (1 - y^{j}) \frac{x^{j - 1} (j θ σ)}{1 \ln (10) - σ x^{j} θ \ln (10)}$

Step 4.2

Multiply $\ln (10)$ by $1$ .

$- y^{j} \log (σ) θ (j x^{j - 1}) + (1 - y^{j}) \frac{x^{j - 1} (j θ σ)}{\ln (10) - σ x^{j} θ \ln (10)}$

Step 4.3

Reorder terms.

$- x^{j - 1} y^{j} j θ \log (σ) + (1 - y^{j}) \frac{x^{j - 1} (j θ σ)}{\ln (10) - σ x^{j} θ \ln (10)}$